Nov 02 14:14:39 devstack cinder-volume[75728]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 14:14:39 devstack cinder-volume[75728]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 14:14:39 devstack cinder-volume[75728]: we strongly recommend against using it for new projects. Nov 02 14:14:39 devstack cinder-volume[75728]: If you are already using Eventlet, we recommend migrating to a different Nov 02 14:14:39 devstack cinder-volume[75728]: framework. For more detail see Nov 02 14:14:39 devstack cinder-volume[75728]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 14:14:39 devstack cinder-volume[75728]: import eventlet # noqa Nov 02 14:14:42 devstack cinder-volume[75728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 14:14:42 devstack cinder-volume[75728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 14:14:42 devstack cinder-volume[75728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 14:14:43 devstack cinder-volume[75728]: INFO dbcounter [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Registered counter for database cinder Nov 02 14:14:43 devstack cinder-volume[75728]: DEBUG oslo_db.sqlalchemy.engines [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75728) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:14:43 devstack cinder-volume[75728]: DEBUG dbcounter [-] [75728] Writer thread running {{(pid=75728) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 14:14:43 devstack cinder-volume[75728]: INFO cinder.rpc [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 14:14:43 devstack cinder-volume[75728]: INFO cinder.rpc [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 14:14:43 devstack cinder-volume[75728]: DEBUG oslo_db.sqlalchemy.engines [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75728) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:14:43 devstack cinder-volume[75728]: INFO cinder.volume.manager [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Determined volume DB was empty at startup. Nov 02 14:14:43 devstack cinder-volume[75728]: DEBUG cinder.volume.manager [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75728) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 14:14:43 devstack cinder-volume[75728]: INFO cinder.volume.manager [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 14:14:43 devstack cinder-volume[75728]: WARNING stevedore.named [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 14:14:43 devstack cinder-volume[75728]: WARNING castellan.key_manager [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 14:14:43 devstack cinder-volume[75728]: WARNING cinder.keymgr.conf_key_mgr [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 14:14:43 devstack cinder-volume[75728]: DEBUG cinder.volume.drivers.lvm [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75728) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 14:14:43 devstack cinder-volume[75728]: DEBUG oslo_concurrency.processutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75728) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_concurrency.processutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] CMD "cinder-rtstool verify" returned: 0 in 0.412s {{(pid=75728) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_db.sqlalchemy.engines [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75728) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:14:44 devstack cinder-volume[75728]: INFO cinder.rpc [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 14:14:44 devstack cinder-volume[75728]: INFO cinder.rpc [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 14:14:44 devstack cinder-volume[75728]: WARNING stevedore.named [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 14:14:44 devstack cinder-volume[75728]: WARNING castellan.key_manager [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 14:14:44 devstack cinder-volume[75728]: INFO cinder.volume.manager [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_db.sqlalchemy.engines [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75728) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:14:44 devstack cinder-volume[75728]: INFO oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Starting 1 workers Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Started child 75883 {{(pid=75728) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Full set of CONF: {{(pid=75728) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] ******************************************************************************** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Configuration options gathered from: {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] ================================================================================ {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 14:14:44 devstack cinder-volume[75883]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] allow_availability_zone_fallback = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] allow_compression_on_image_upload = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] allowed_direct_url_schemes = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] api_rate_limit = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] auth_strategy = keystone {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] az_cache_duration = 3600 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_availability_zone = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_host = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_stats_polling_interval = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backup_api_class = cinder.backup.api.API {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backup_name_template = backup-%s {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backup_use_same_host = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backup_use_temp_snapshot = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] chap_password = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] chap_username = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_internal_tenant_project_id = 9f477d5877fa4396b372b54903904d5b {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_internal_tenant_user_id = cbec098b254542a1b4a9e1ed1768d166 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cloned_volume_same_az = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cluster = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] compression_format = gzip {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] compute_api_class = cinder.compute.nova.API {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] config_dir = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] config_source = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] control_exchange = openstack {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] debug = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] default_availability_zone = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] default_group_type = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] default_volume_type = lvmdriver-1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] disk_geometry = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] driver_client_cert = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] driver_client_cert_key = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] driver_data_namespace = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] driver_ssl_cert_path = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] driver_ssl_cert_verify = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] driver_use_ssl = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] enable_force_upload = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] enable_new_services = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] enable_unsupported_driver = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] enforce_multipath_for_image_xfer = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] filter_function = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_api_insecure = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_api_ssl_compression = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_ca_certificates_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_catalog_info = image:glance:publicURL {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_num_retries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance_request_timeout = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] goodness_function = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] graceful_shutdown_timeout = 5 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] group_api_class = cinder.group.api.API {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] host = devstack {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_compress_on_upload = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_conversion_address_space_limit = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_conversion_cpu_limit = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_conversion_disable = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_introspection_address_space_limit = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_introspection_cpu_limit = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_upload_use_cinder_backend = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_upload_use_internal_tenant = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_volume_cache_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_volume_cache_max_count = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] image_volume_cache_max_size_gb = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] init_host_max_objects_retrieval = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] instance_format = [instance: %(uuid)s] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] iscsi_target_flags = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] iscsi_write_cache = on {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] iser_helper = tgtadm {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] iser_ip_address = 192.168.122.208 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] iser_port = 3260 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_color = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_config_append = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_dir = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75883]: INFO cinder.volume.manager [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_options = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_rotate_interval = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_rotate_interval_type = days {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] log_rotation_type = none {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] max_age = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] max_logfile_count = 30 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] max_logfile_size_mb = 200 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] max_over_subscription_ratio = 20.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] message_reap_interval = 86400 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] message_ttl = 2592000 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] migration_create_volume_timeout_secs = 300 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] monkey_patch = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] monkey_patch_modules = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] my_ip = 192.168.122.208 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] no_snapshot_gb_quota = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] num_iser_scan_tries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] num_shell_tries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] num_volume_device_scan_tries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] nvmeof_conn_info_version = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] nvmet_ns_id = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] nvmet_port_id = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] osapi_max_limit = 1000 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] osapi_volume_ext_list = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] osapi_volume_listen_port = 8776 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] osapi_volume_use_ssl = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] osapi_volume_workers = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] per_volume_size_limit = -1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] periodic_fuzzy_delay = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] periodic_interval = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] public_endpoint = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] publish_errors = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] quota_backup_gigabytes = 1000 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] quota_backups = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] quota_gigabytes = 1000 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] quota_groups = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] quota_snapshots = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] quota_volumes = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] rate_limit_burst = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] rate_limit_except_level = CRITICAL {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] rate_limit_interval = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] reinit_driver_count = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] replication_device = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] report_discard_supported = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] report_interval = 120 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] reservation_clean_interval = 86400 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] reservation_expire = 86400 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] reserved_image_namespaces = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] reserved_percentage = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] rpc_response_timeout = 120 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] run_external_periodic_tasks = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] scst_target_driver = iscsi {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] scst_target_iqn_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_down_time = 720 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] shell_completion = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] snapshot_name_template = snapshot-%s {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] snapshot_same_host = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] split_loggers = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] state_path = /opt/stack/data/cinder {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] storage_availability_zone = nova {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] storage_protocol = iSCSI {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] syslog_log_facility = LOG_USER {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] target_helper = lioadm {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] target_ip_address = 192.168.122.208 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] target_port = 3260 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] target_protocol = iscsi {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] target_secondary_ip_addresses = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] trace_flags = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] transport_url = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] until_refresh = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] use_chap_auth = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] use_default_quota_class = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] use_journal = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] use_json = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] use_multipath_for_image_xfer = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] use_stderr = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] use_syslog = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] verify_glance_signatures = enabled {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_api_class = cinder.volume.api.API {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_backend_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_clear = zero {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_clear_ionice = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_clear_size = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_copy_bps_limit = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_dd_blocksize = 1M {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_name_template = volume-%s {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_service_inithost_offload = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volume_usage_audit_period = month {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] zoning_mode = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_concurrency.disable_process_locking = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.auth_section = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.auth_type = password {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.auth_version = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.cache = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.include_service_catalog = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.insecure = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.interface = public {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_password = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcache_username = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.region_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.service_type = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.backend = dogpile.cache.null {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.backend_argument = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.backend_expiration_time = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.config_prefix = cache.oslo {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.debug_cache_backend = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.enable_retry_client = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.enable_socket_keepalive = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.expiration_time = 600 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.hashclient_retry_attempts = 2 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.memcache_dead_retry = 300 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.memcache_pool_maxsize = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.memcache_sasl_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.password = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.proxies = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.redis_db = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.redis_server = localhost:6379 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.retry_attempts = 2 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.retry_delay = 0.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.socket_keepalive_count = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.socket_keepalive_idle = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:44 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.socket_keepalive_interval = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.socket_timeout = 1.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.tls_allowed_ciphers = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.tls_cafile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.tls_certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.tls_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.tls_keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cache.username = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] coordination.backend_url = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.asyncio_connection = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.asyncio_slave_connection = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.backend = sqlalchemy {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.connection = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.connection_debug = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.connection_parameters = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.connection_recycle_time = 3600 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.connection_trace = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.db_inc_retry_interval = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.db_max_retries = 20 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.db_max_retry_interval = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.db_retry_interval = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.max_overflow = 50 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.max_pool_size = 5 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.max_retries = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.mysql_wsrep_sync_wait = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.pool_timeout = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.retry_interval = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.slave_connection = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.sqlite_synchronous = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.synchronous_reader = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] database.use_db_reconnect = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_tracing.insecure = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.connection_string = messaging:// {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.es_doc_type = notification {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.es_scroll_size = 10000 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.es_scroll_time = 2m {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.filter_error_trace = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.hmac_keys = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.sentinel_service_name = mymaster {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.socket_timeout = 0.1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.trace_requests = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler.trace_sqlalchemy = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler_jaeger.process_tags = {} {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler_jaeger.service_name_prefix = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] profiler_otlp.service_name_prefix = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.enforce_new_defaults = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.policy_default_rule = default {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.policy_file = policy.yaml {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] privsep_osbrick.group = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] privsep_osbrick.helper_command = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] privsep_osbrick.user = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_sys_admin.group = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_sys_admin.helper_command = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] cinder_sys_admin.user = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.auth_section = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.auth_type = password {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.cafile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.collect_timing = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.insecure = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.send_service_user_token = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.split_loggers = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.timeout = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.tls_ciphers = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] service_user.tls_min_version = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.auth_section = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.auth_type = password {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.collect_timing = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.insecure = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.region_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.split_loggers = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.timeout = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.tls_ciphers = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] glance.tls_min_version = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.backend_availability_zone = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.chap_password = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.chap_username = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.disk_geometry = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.driver_client_cert = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.driver_client_cert_key = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.driver_data_namespace = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.driver_use_ssl = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.extra_capabilities = {} {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.filter_function = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.goodness_function = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.iscsi_target_flags = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.iscsi_write_cache = on {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.iser_helper = tgtadm {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.iser_port = 3260 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.lvm_share_target = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.lvm_type = auto {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack sudo[75888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.num_shell_tries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.replication_device = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.report_discard_supported = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.reserved_percentage = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.target_helper = tgtadm {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.target_port = 3260 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.target_protocol = iscsi {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.trace_flags = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.unique_fqdn_network = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.use_chap_auth = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack sudo[75888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_backend_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_clear = zero {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_clear_ionice = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_clear_size = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_reports.file_event_handler = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_reports.log_dir = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.backend_host = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.chap_password = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.chap_username = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.disk_geometry = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.driver_client_cert = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.extra_capabilities = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.filter_function = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.goodness_function = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.iser_helper = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.iser_ip_address = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.iser_port = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.lvm_share_target = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.lvm_type = auto {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.num_shell_tries = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.replication_device = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.report_discard_supported = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.reserved_percentage = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.scst_target_driver = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.storage_protocol = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.target_helper = lioadm {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.target_ip_address = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.target_port = 3260 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.trace_flags = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.use_chap_auth = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_clear = zero {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_clear_size = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] lvmdriver-1.volumes_dir = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.ssl = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_notifications.driver = [] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_notifications.retry = -1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] key_manager.fixed_key = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.barbican_api_version = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.barbican_endpoint = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.barbican_endpoint_type = public {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.barbican_region_name = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.cafile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.collect_timing = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.insecure = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.number_of_retries = 60 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.retry_delay = 1 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.send_service_user_token = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.split_loggers = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.timeout = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.tls_ciphers = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.tls_min_version = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.verify_ssl = True {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican.verify_ssl_path = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.auth_section = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.auth_type = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.cafile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.certfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.collect_timing = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.insecure = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.keyfile = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.split_loggers = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.timeout = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.tls_ciphers = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] barbican_service_user.tls_min_version = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.approle_role_id = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.approle_secret_id = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.auth_method = approle {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.auth_path = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.kv_mountpoint = secret {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.kv_path = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.kv_version = 2 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.namespace = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.root_token_id = **** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.ssl_ca_crt_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.timeout = 60.0 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.token_file = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.token_role = None {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.use_ssl = False {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:14:44 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] ******************************************************************************** {{(pid=75728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 14:14:45 devstack sudo[75888]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:45 devstack sudo[75895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:45 devstack sudo[75895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:45 devstack sudo[75895]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.285s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:14:45 devstack cinder-volume[75883]: INFO cinder.brick.local_dev.lvm [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:45 devstack sudo[76017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:14:45 devstack sudo[76017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:45 devstack sudo[76017]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG cinder.brick.local_dev.lvm [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75883) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 14:14:45 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:45 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:45 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:46 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:46 devstack sudo[76296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:46 devstack sudo[76296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:46 devstack sudo[76296]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:46 devstack sudo[76383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 14:14:46 devstack sudo[76383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:46 devstack sudo[76383]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.276s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:46 devstack sudo[76479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:14:46 devstack sudo[76479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:46 devstack sudo[76479]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:46 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:47 devstack sudo[76506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:14:47 devstack sudo[76506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:47 devstack sudo[76506]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:47 devstack sudo[76563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:14:47 devstack sudo[76563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:47 devstack sudo[76563]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:47 devstack sudo[76593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:47 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:47 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:47 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:47 devstack sudo[76603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:47 devstack sudo[76603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:48 devstack sudo[76603]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:48 devstack cinder-volume[75883]: INFO cinder.volume.drivers.lvm [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:48 devstack sudo[76691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:48 devstack sudo[76691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:48 devstack sudo[76691]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Updating volume stats {{(pid=75883) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:48 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:14:48 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:48 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:48 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:48 devstack sudo[76699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:14:48 devstack sudo[76699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:49 devstack sudo[76699]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:49 devstack sudo[76702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:49 devstack sudo[76702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:49 devstack sudo[76702]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:49 devstack sudo[76705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:14:49 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:49 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:49 devstack cinder-volume[75883]: INFO cinder.volume.driver [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG cinder.volume.driver [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75883) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG oslo_db.sqlalchemy.engines [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75883) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writer thread running {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG cinder.db.api [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Building query based on filter {{(pid=75883) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG cinder.image.image_utils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75883) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 14:14:49 devstack cinder-volume[75883]: INFO cinder.keymgr.migration [None req-e45f4633-f460-462b-b1c8-129626799652 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Updating volume stats {{(pid=75883) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 14:14:49 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:49 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:14:49 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:50 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:50 devstack sudo[76711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:14:50 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:50 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:50 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:50 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:50 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:50 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:14:50 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:50 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG cinder.manager [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Notifying Schedulers of capabilities ... {{(pid=75883) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:14:50 devstack cinder-volume[75883]: INFO cinder.volume.manager [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Driver initialization completed successfully. Nov 02 14:14:50 devstack cinder-volume[75883]: INFO cinder.manager [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Initiating service 2 cleanup Nov 02 14:14:50 devstack cinder-volume[75883]: INFO cinder.manager [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Service 2 cleanup completed. Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG cinder.service [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Creating RPC server for service cinder-volume {{(pid=75883) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 14:14:50 devstack cinder-volume[75883]: DEBUG cinder.service [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75883) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 14:14:51 devstack cinder-volume[75883]: INFO cinder.volume.manager [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Updating volume stats {{(pid=75883) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:51 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:14:51 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:51 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:51 devstack sudo[76726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:14:51 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:51 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:51 devstack sudo[76734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:14:51 devstack sudo[76734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:51 devstack sudo[76734]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:51 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:14:51 devstack sudo[76737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:14:51 devstack sudo[76737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:14:52 devstack sudo[76737]: pam_unix(sudo:session): session closed for user root Nov 02 14:14:52 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:14:52 devstack cinder-volume[75883]: INFO cinder.volume.manager [None req-fdcc46aa-6224-43b5-993d-8ece6c966f00 None None] Driver post RPC initialization completed successfully. Nov 02 14:14:54 devstack cinder-volume[75728]: DEBUG dbcounter [-] [75728] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75728) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:15:00 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager._thread_info {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:15:00 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread count: 6 {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:15:00 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread info: [<_MainThread(MainThread, started 132029278331008)>, , , , , ] {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:15:02 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writing DB stats cinder:SELECT=3 {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:15:02 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Updating volume stats {{(pid=75883) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:16:00 devstack sudo[78981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:16:00 devstack sudo[78981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:16:00 devstack sudo[78981]: pam_unix(sudo:session): session closed for user root Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:16:00 devstack sudo[78984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:16:00 devstack sudo[78984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:16:00 devstack sudo[78984]: pam_unix(sudo:session): session closed for user root Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:16:00 devstack sudo[78987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:16:00 devstack sudo[78987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:16:00 devstack sudo[78987]: pam_unix(sudo:session): session closed for user root Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:16:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:16:00 devstack sudo[79006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:16:00 devstack sudo[79006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:16:01 devstack sudo[79006]: pam_unix(sudo:session): session closed for user root Nov 02 14:16:01 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:16:01 devstack cinder-volume[75883]: DEBUG cinder.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Notifying Schedulers of capabilities ... {{(pid=75883) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:16:01 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager._thread_info {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:16:01 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread count: 6 {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:16:01 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread info: [<_MainThread(MainThread, started 132029278331008)>, , , , , ] {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Updating volume stats {{(pid=75883) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:17:00 devstack sudo[82147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:17:00 devstack sudo[82147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:17:00 devstack sudo[82147]: pam_unix(sudo:session): session closed for user root Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:17:00 devstack sudo[82190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:17:00 devstack sudo[82190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:17:00 devstack sudo[82190]: pam_unix(sudo:session): session closed for user root Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:17:00 devstack sudo[82194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:17:00 devstack sudo[82194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:17:00 devstack sudo[82194]: pam_unix(sudo:session): session closed for user root Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:17:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:17:01 devstack sudo[82201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:17:01 devstack sudo[82201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:17:01 devstack sudo[82201]: pam_unix(sudo:session): session closed for user root Nov 02 14:17:01 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:17:01 devstack cinder-volume[75883]: DEBUG cinder.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Notifying Schedulers of capabilities ... {{(pid=75883) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:17:01 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager._thread_info {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:17:01 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread count: 6 {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:17:01 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread info: [<_MainThread(MainThread, started 132029278331008)>, , , , , ] {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:17:02 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:18:00 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:18:00 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Updating volume stats {{(pid=75883) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 14:18:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:18:00 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:18:00 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:18:00 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Nov 02 14:18:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:18:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:18:00 devstack sudo[84285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:18:00 devstack sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:18:00 devstack sudo[84285]: pam_unix(sudo:session): session closed for user root Nov 02 14:18:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:18:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:18:00 devstack sudo[84305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:18:00 devstack sudo[84305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:18:01 devstack sudo[84305]: pam_unix(sudo:session): session closed for user root Nov 02 14:18:01 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:18:01 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:18:01 devstack sudo[84308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:18:01 devstack sudo[84308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:18:01 devstack sudo[84308]: pam_unix(sudo:session): session closed for user root Nov 02 14:18:01 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:18:01 devstack cinder-volume[75883]: DEBUG cinder.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Notifying Schedulers of capabilities ... {{(pid=75883) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:18:01 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager._thread_info {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:18:01 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread count: 6 {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:18:01 devstack cinder-volume[75883]: DEBUG cinder.volume.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] thread info: [<_MainThread(MainThread, started 132029278331008)>, , , , , ] {{(pid=75883) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_service.periodic_task [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75883) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG cinder.volume.drivers.lvm [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Updating volume stats {{(pid=75883) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:00 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 14:19:00 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:00 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:00 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:19:00 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:00 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:00 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 14:19:00 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:00 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:00 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:00 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 14:19:00 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:01 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:01 devstack cinder-volume[75883]: DEBUG oslo_concurrency.processutils [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75883) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:01 devstack cinder-volume[75883]: DEBUG cinder.manager [None req-10354f5c-a632-4096-8ba3-f45175e15108 None None] Notifying Schedulers of capabilities ... {{(pid=75883) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:19:02 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writing DB stats cinder:SELECT=1 {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:19:02 devstack cinder-volume[75883]: DEBUG dbcounter [-] [75883] Writing DB stats cinder:UPDATE=1 {{(pid=75883) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:19:17 devstack cinder-volume[75728]: INFO oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Caught SIGTERM, stopping children Nov 02 14:19:17 devstack cinder-volume[75728]: DEBUG oslo_concurrency.lockutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Acquiring lock "singleton_lock" {{(pid=75728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 14:19:17 devstack cinder-volume[75728]: DEBUG oslo_concurrency.lockutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Acquired lock "singleton_lock" {{(pid=75728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 14:19:17 devstack cinder-volume[75728]: DEBUG oslo_concurrency.lockutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Releasing lock "singleton_lock" {{(pid=75728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 14:19:17 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Stop services. {{(pid=75728) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 14:19:17 devstack cinder-volume[75728]: DEBUG oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Killing children. {{(pid=75728) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 14:19:17 devstack cinder-volume[75728]: INFO oslo_service.backend._eventlet.service [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Waiting on 1 children to exit Nov 02 14:19:22 devstack cinder-volume[75883]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 02 14:19:23 devstack cinder-volume[85947]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 14:19:23 devstack cinder-volume[85947]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 14:19:23 devstack cinder-volume[85947]: we strongly recommend against using it for new projects. Nov 02 14:19:23 devstack cinder-volume[85947]: If you are already using Eventlet, we recommend migrating to a different Nov 02 14:19:23 devstack cinder-volume[85947]: framework. For more detail see Nov 02 14:19:23 devstack cinder-volume[85947]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 14:19:23 devstack cinder-volume[85947]: import eventlet # noqa Nov 02 14:19:25 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 14:19:25 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 14:19:25 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 14:19:25 devstack cinder-volume[85947]: INFO dbcounter [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Registered counter for database cinder Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_db.sqlalchemy.engines [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:26 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Acquiring lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 14:19:26 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Acquired lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 14:19:26 devstack cinder-volume[75883]: DEBUG oslo_concurrency.lockutils [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Releasing lock "singleton_lock" {{(pid=75883) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 14:19:26 devstack cinder-volume[75883]: WARNING amqp [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 14:19:26 devstack cinder-volume[75883]: WARNING amqp [None req-7111dff2-2977-401a-8eed-5de9457dae37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG dbcounter [-] [85947] Writer thread running {{(pid=85947) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 14:19:26 devstack cinder-volume[85947]: INFO cinder.rpc [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 14:19:26 devstack cinder-volume[85947]: INFO cinder.rpc [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_db.sqlalchemy.engines [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:26 devstack cinder-volume[85947]: INFO cinder.volume.manager [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Determined volume DB was empty at startup. Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG cinder.volume.manager [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85947) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 14:19:26 devstack cinder-volume[85947]: INFO cinder.volume.manager [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 14:19:26 devstack cinder-volume[85947]: WARNING stevedore.named [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 14:19:26 devstack cinder-volume[85947]: WARNING castellan.key_manager [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 14:19:26 devstack cinder-volume[85947]: WARNING cinder.keymgr.conf_key_mgr [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 14:19:26 devstack cinder-volume[85947]: INFO cinder.volume.manager [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_db.sqlalchemy.engines [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:26 devstack cinder-volume[85947]: INFO oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Starting 1 workers Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Started child 86171 {{(pid=85947) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Full set of CONF: {{(pid=85947) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] ******************************************************************************** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Configuration options gathered from: {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] ================================================================================ {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] allow_availability_zone_fallback = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] allow_compression_on_image_upload = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] allowed_direct_url_schemes = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] api_rate_limit = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] auth_strategy = keystone {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_availability_zone = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_host = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[86171]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_stats_polling_interval = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backup_api_class = cinder.backup.api.API {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backup_name_template = backup-%s {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backup_use_same_host = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backup_use_temp_snapshot = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] chap_password = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] chap_username = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_internal_tenant_project_id = 9f477d5877fa4396b372b54903904d5b {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_internal_tenant_user_id = cbec098b254542a1b4a9e1ed1768d166 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cluster = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] compression_format = gzip {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] compute_api_class = cinder.compute.nova.API {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] config_dir = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] config_source = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] control_exchange = openstack {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] debug = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] default_availability_zone = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] default_group_type = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] default_volume_type = QuobyteHD {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] disk_geometry = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] driver_client_cert = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] driver_client_cert_key = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] driver_data_namespace = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] driver_ssl_cert_path = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] driver_ssl_cert_verify = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] driver_use_ssl = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] enable_new_services = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] enable_unsupported_driver = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] enabled_backends = ['QuobyteHD'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] enforce_multipath_for_image_xfer = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] filter_function = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_api_insecure = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_api_ssl_compression = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_ca_certificates_file = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_catalog_info = image:glance:publicURL {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_num_retries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance_request_timeout = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] goodness_function = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] graceful_shutdown_timeout = 5 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] group_api_class = cinder.group.api.API {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] host = devstack {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_compress_on_upload = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_conversion_address_space_limit = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_conversion_cpu_limit = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_conversion_disable = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_introspection_address_space_limit = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_introspection_cpu_limit = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_upload_use_cinder_backend = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_upload_use_internal_tenant = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_volume_cache_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_volume_cache_max_count = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] image_volume_cache_max_size_gb = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] init_host_max_objects_retrieval = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] instance_format = [instance: %(uuid)s] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] iscsi_target_flags = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] iscsi_write_cache = on {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] iser_helper = tgtadm {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] iser_ip_address = 192.168.122.208 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] iser_port = 3260 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_color = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_config_append = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_dir = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_file = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_options = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_rotate_interval = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_rotate_interval_type = days {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] log_rotation_type = none {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] max_age = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] max_logfile_count = 30 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] max_logfile_size_mb = 200 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] max_over_subscription_ratio = 20.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] message_reap_interval = 86400 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] message_ttl = 2592000 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] migration_create_volume_timeout_secs = 300 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] monkey_patch = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] monkey_patch_modules = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] my_ip = 192.168.122.208 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] no_snapshot_gb_quota = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] num_iser_scan_tries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] num_shell_tries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] num_volume_device_scan_tries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] nvmeof_conn_info_version = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] nvmet_ns_id = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] nvmet_port_id = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] osapi_max_limit = 1000 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] osapi_volume_ext_list = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] osapi_volume_listen_port = 8776 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] osapi_volume_use_ssl = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] osapi_volume_workers = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] per_volume_size_limit = -1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] periodic_fuzzy_delay = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] periodic_interval = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] public_endpoint = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] publish_errors = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] quota_backup_gigabytes = 1000 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] quota_backups = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] quota_gigabytes = 1000 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] quota_groups = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] quota_snapshots = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] quota_volumes = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] rate_limit_burst = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] rate_limit_except_level = CRITICAL {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] rate_limit_interval = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] reinit_driver_count = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] replication_device = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] report_discard_supported = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] report_interval = 120 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] reservation_clean_interval = 86400 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] reservation_expire = 86400 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] reserved_image_namespaces = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] reserved_percentage = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] rpc_response_timeout = 120 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] run_external_periodic_tasks = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] scst_target_driver = iscsi {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] scst_target_iqn_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_down_time = 720 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] shell_completion = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] snapshot_name_template = snapshot-%s {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] split_loggers = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] state_path = /opt/stack/data/cinder {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] storage_availability_zone = nova {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] storage_protocol = iSCSI {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] syslog_log_facility = LOG_USER {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] target_helper = lioadm {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] target_ip_address = 192.168.122.208 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] target_port = 3260 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] target_protocol = iscsi {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] target_secondary_ip_addresses = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] trace_flags = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] transport_url = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] until_refresh = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] use_chap_auth = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] use_default_quota_class = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] use_journal = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] use_json = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[86171]: INFO cinder.volume.manager [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] use_multipath_for_image_xfer = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.remotefs [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86171) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] use_stderr = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] use_syslog = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] verify_glance_signatures = enabled {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_api_class = cinder.volume.api.API {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_backend_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_clear = zero {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_clear_ionice = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_clear_size = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_copy_bps_limit = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_dd_blocksize = 1M {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_name_template = volume-%s {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_service_inithost_offload = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volume_usage_audit_period = month {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] zoning_mode = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_concurrency.disable_process_locking = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.auth_section = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.auth_type = password {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.auth_version = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.cache = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.include_service_catalog = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.insecure = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.interface = public {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_password = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcache_username = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.region_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.service_type = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.backend = dogpile.cache.null {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.backend_argument = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.backend_expiration_time = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.config_prefix = cache.oslo {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.debug_cache_backend = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.enable_retry_client = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.enable_socket_keepalive = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.expiration_time = 600 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.hashclient_retry_attempts = 2 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.memcache_dead_retry = 300 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.memcache_pool_maxsize = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.memcache_sasl_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.password = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.proxies = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.redis_db = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.redis_server = localhost:6379 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.retry_attempts = 2 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.retry_delay = 0.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.socket_keepalive_count = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.socket_keepalive_idle = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.socket_keepalive_interval = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.socket_timeout = 1.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.tls_allowed_ciphers = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.tls_cafile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.tls_certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.tls_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.tls_keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cache.username = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] coordination.backend_url = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.asyncio_connection = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.asyncio_slave_connection = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.backend = sqlalchemy {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.connection = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.connection_debug = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.connection_parameters = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.connection_recycle_time = 3600 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.connection_trace = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.db_inc_retry_interval = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.db_max_retries = 20 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.db_max_retry_interval = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.db_retry_interval = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:26 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.max_overflow = 50 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.max_pool_size = 5 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.max_retries = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.mysql_wsrep_sync_wait = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.pool_timeout = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.retry_interval = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.slave_connection = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.sqlite_synchronous = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.synchronous_reader = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] database.use_db_reconnect = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_tracing.insecure = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.connection_string = messaging:// {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.es_doc_type = notification {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.es_scroll_size = 10000 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.es_scroll_time = 2m {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.filter_error_trace = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.hmac_keys = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.sentinel_service_name = mymaster {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.socket_timeout = 0.1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.trace_requests = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler.trace_sqlalchemy = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler_jaeger.process_tags = {} {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler_jaeger.service_name_prefix = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] profiler_otlp.service_name_prefix = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.enforce_new_defaults = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.policy_default_rule = default {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.policy_file = policy.yaml {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] privsep_osbrick.group = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] privsep_osbrick.helper_command = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] privsep_osbrick.user = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_sys_admin.group = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_sys_admin.helper_command = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] cinder_sys_admin.user = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.auth_section = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.auth_type = password {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.cafile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.collect_timing = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.insecure = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.send_service_user_token = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.split_loggers = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.timeout = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.tls_ciphers = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] service_user.tls_min_version = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.auth_section = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.auth_type = password {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.collect_timing = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.insecure = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.region_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.split_loggers = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.timeout = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.tls_ciphers = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] glance.tls_min_version = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.backend_availability_zone = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.chap_password = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.chap_username = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.disk_geometry = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.driver_client_cert = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.driver_client_cert_key = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.driver_data_namespace = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.driver_use_ssl = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.extra_capabilities = {} {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.filter_function = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.goodness_function = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.iscsi_target_flags = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.iscsi_write_cache = on {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.iser_helper = tgtadm {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.iser_port = 3260 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_host = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_login = admin {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_mount_options = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_password = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_private_key = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_share_path = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_ssh_port = 22 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.num_shell_tries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.quobyte_client_cfg = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.quobyte_volume_url = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.replication_device = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.report_discard_supported = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.reserved_percentage = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.target_helper = tgtadm {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.target_port = 3260 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.target_protocol = iscsi {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.trace_flags = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.unique_fqdn_network = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.use_chap_auth = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_backend_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_clear = zero {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_clear_ionice = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_clear_size = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_reports.file_event_handler = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_reports.log_dir = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.backend_availability_zone = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.backend_host = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.chap_password = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.chap_username = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.chiscsi_conf = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.disk_geometry = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.driver_client_cert = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.driver_client_cert_key = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.driver_data_namespace = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.driver_use_ssl = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.extra_capabilities = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.filter_function = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.goodness_function = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.iscsi_target_flags = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.iscsi_write_cache = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.iser_helper = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.iser_ip_address = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.iser_port = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.iser_target_prefix = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_host = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_login = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_mount_options = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86171) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 14:19:27 devstack cinder-volume[86171]: WARNING cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_password = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[86171]: WARNING cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_private_key = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_share_path = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_ssh_port = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.num_shell_tries = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nvmet_ns_id = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.nvmet_port_id = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.replication_device = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.report_discard_supported = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.reserved_percentage = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.scst_target_driver = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.storage_protocol = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.target_helper = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.target_ip_address = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.target_port = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.target_prefix = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.target_protocol = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.trace_flags = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.unique_fqdn_network = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.use_chap_auth = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_clear = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_clear_ionice = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_clear_size = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] QuobyteHD.volumes_dir = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.ssl = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_notifications.driver = [] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_notifications.retry = -1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] key_manager.fixed_key = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.barbican_api_version = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.barbican_endpoint = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.barbican_endpoint_type = public {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.barbican_region_name = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.cafile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.collect_timing = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.insecure = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.number_of_retries = 60 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.retry_delay = 1 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.send_service_user_token = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.split_loggers = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.timeout = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.tls_ciphers = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.tls_min_version = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.verify_ssl = True {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican.verify_ssl_path = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.auth_section = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.auth_type = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.cafile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.certfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.collect_timing = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.insecure = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.keyfile = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.split_loggers = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.timeout = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.tls_ciphers = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] barbican_service_user.tls_min_version = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.approle_role_id = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.approle_secret_id = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.auth_method = approle {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.auth_path = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.kv_mountpoint = secret {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.kv_path = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.kv_version = 2 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.namespace = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.root_token_id = **** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.ssl_ca_crt_file = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.timeout = 60.0 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.token_file = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.token_role = None {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.use_ssl = False {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:27 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] ******************************************************************************** {{(pid=85947) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 14:19:27 devstack quobyte-client[86174]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 14:19:27 devstack quobyte-client[86174]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] CMD "mount.quobyte" returned: 1 in 0.102s {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:19:27 devstack cinder-volume[86171]: INFO cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 ... Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 -c /etc/quobyte/client-cinder.cfg {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:27 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 -c /etc/quobyte/client-cinder.cfg Nov 02 14:19:27 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:27 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.395s {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:27 devstack cinder-volume[86171]: INFO cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 succeeded Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.407s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:27 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:19:27 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:27 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.243s {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:27 devstack cinder-volume[86171]: INFO cinder.volume.driver [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.volume.driver [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8324928283691, 'free_capacity_gb': 1773.8324928283691, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86171) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_db.sqlalchemy.engines [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86171) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG dbcounter [-] [86171] Writer thread running {{(pid=86171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.db.api [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Building query based on filter {{(pid=86171) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.image.image_utils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86171) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 14:19:27 devstack cinder-volume[86171]: INFO cinder.keymgr.migration [None req-c185aadd-7a77-478f-8c76-e12903c890a5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:19:27 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:28 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:19:28 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:28 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.245s {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG cinder.manager [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Notifying Schedulers of capabilities ... {{(pid=86171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:19:28 devstack cinder-volume[86171]: INFO cinder.volume.manager [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Driver initialization completed successfully. Nov 02 14:19:28 devstack cinder-volume[86171]: INFO cinder.manager [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Initiating service 3 cleanup Nov 02 14:19:28 devstack cinder-volume[86171]: INFO cinder.manager [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Service 3 cleanup completed. Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG cinder.service [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Creating RPC server for service cinder-volume {{(pid=86171) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG cinder.service [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86171) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 14:19:28 devstack cinder-volume[86171]: INFO cinder.volume.manager [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:28 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:19:28 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:28 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:28 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.252s {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:28 devstack cinder-volume[86171]: INFO cinder.volume.manager [None req-93f96408-1281-4894-a669-327f2c32e1e7 None None] Driver post RPC initialization completed successfully. Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86171) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG cinder.volume.drivers.quobyte [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86171) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86171) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:33 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:19:33 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:33 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG oslo_concurrency.processutils [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.230s {{(pid=86171) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:33 devstack cinder-volume[86171]: DEBUG cinder.manager [None req-b5a1dd30-bc06-4fba-a6c6-a4098cd457e2 None None] Notifying Schedulers of capabilities ... {{(pid=86171) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:19:36 devstack cinder-volume[85947]: INFO oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Caught SIGTERM, stopping children Nov 02 14:19:36 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Acquiring lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 14:19:36 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Acquired lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 14:19:36 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Releasing lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 14:19:36 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Stop services. {{(pid=85947) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 14:19:36 devstack cinder-volume[85947]: DEBUG oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Killing children. {{(pid=85947) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 14:19:36 devstack cinder-volume[85947]: INFO oslo_service.backend._eventlet.service [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Waiting on 1 children to exit Nov 02 14:19:38 devstack cinder-volume[86171]: DEBUG dbcounter [-] [86171] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:19:38 devstack cinder-volume[86171]: DEBUG dbcounter [-] [86171] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86171) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:19:41 devstack cinder-volume[86171]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 02 14:19:41 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Acquiring lock "singleton_lock" {{(pid=86171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 14:19:41 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Acquired lock "singleton_lock" {{(pid=86171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 14:19:41 devstack cinder-volume[86171]: DEBUG oslo_concurrency.lockutils [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Releasing lock "singleton_lock" {{(pid=86171) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 14:19:41 devstack cinder-volume[86171]: WARNING amqp [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 14:19:41 devstack cinder-volume[86171]: WARNING amqp [None req-723ba70a-7f30-4284-aa87-50cc31992c6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 14:19:42 devstack cinder-volume[86705]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 14:19:42 devstack cinder-volume[86705]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 14:19:42 devstack cinder-volume[86705]: we strongly recommend against using it for new projects. Nov 02 14:19:42 devstack cinder-volume[86705]: If you are already using Eventlet, we recommend migrating to a different Nov 02 14:19:42 devstack cinder-volume[86705]: framework. For more detail see Nov 02 14:19:42 devstack cinder-volume[86705]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 14:19:42 devstack cinder-volume[86705]: import eventlet # noqa Nov 02 14:19:44 devstack cinder-volume[86705]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 14:19:44 devstack cinder-volume[86705]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 14:19:44 devstack cinder-volume[86705]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86705) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 14:19:45 devstack cinder-volume[86705]: INFO dbcounter [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Registered counter for database cinder Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_db.sqlalchemy.engines [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG dbcounter [-] [86705] Writer thread running {{(pid=86705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 14:19:45 devstack cinder-volume[86705]: INFO cinder.rpc [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 14:19:45 devstack cinder-volume[86705]: INFO cinder.rpc [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_db.sqlalchemy.engines [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:45 devstack cinder-volume[86705]: INFO cinder.volume.manager [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Determined volume DB was empty at startup. Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG cinder.volume.manager [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86705) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 14:19:45 devstack cinder-volume[86705]: WARNING stevedore.named [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 14:19:45 devstack cinder-volume[86705]: WARNING castellan.key_manager [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 14:19:45 devstack cinder-volume[86705]: WARNING cinder.keymgr.conf_key_mgr [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 14:19:45 devstack cinder-volume[86705]: INFO cinder.volume.manager [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_db.sqlalchemy.engines [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86705) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:45 devstack cinder-volume[86705]: INFO oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Starting 1 workers Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Started child 86978 {{(pid=86705) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Full set of CONF: {{(pid=86705) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] ******************************************************************************** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] Configuration options gathered from: {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] ================================================================================ {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] allow_availability_zone_fallback = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86978]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] allow_compression_on_image_upload = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] allowed_direct_url_schemes = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] api_rate_limit = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] auth_strategy = keystone {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_availability_zone = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_host = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_stats_polling_interval = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backup_api_class = cinder.backup.api.API {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backup_name_template = backup-%s {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backup_use_same_host = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backup_use_temp_snapshot = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] chap_password = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] chap_username = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_internal_tenant_project_id = 9f477d5877fa4396b372b54903904d5b {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_internal_tenant_user_id = cbec098b254542a1b4a9e1ed1768d166 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cluster = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] compression_format = gzip {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] compute_api_class = cinder.compute.nova.API {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] config_dir = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] config_source = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] control_exchange = openstack {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] debug = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] default_availability_zone = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] default_group_type = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] default_volume_type = QuobyteHD {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] disk_geometry = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] driver_client_cert = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] driver_client_cert_key = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] driver_data_namespace = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] driver_ssl_cert_path = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] driver_ssl_cert_verify = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] driver_use_ssl = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] enable_new_services = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] enable_unsupported_driver = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] enabled_backends = ['QuobyteHD'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] enforce_multipath_for_image_xfer = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] filter_function = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_api_insecure = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_api_ssl_compression = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_ca_certificates_file = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_catalog_info = image:glance:publicURL {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_num_retries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance_request_timeout = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] goodness_function = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] graceful_shutdown_timeout = 5 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] group_api_class = cinder.group.api.API {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] host = devstack {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_compress_on_upload = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_conversion_address_space_limit = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_conversion_cpu_limit = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_conversion_disable = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_introspection_address_space_limit = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_introspection_cpu_limit = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_upload_use_cinder_backend = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_upload_use_internal_tenant = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_volume_cache_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_volume_cache_max_count = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] image_volume_cache_max_size_gb = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] init_host_max_objects_retrieval = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] instance_format = [instance: %(uuid)s] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] iscsi_target_flags = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] iscsi_write_cache = on {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] iser_helper = tgtadm {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] iser_ip_address = 192.168.122.208 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] iser_port = 3260 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_color = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_config_append = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_dir = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_file = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_options = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_rotate_interval = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_rotate_interval_type = days {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] log_rotation_type = none {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:45 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] max_age = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] max_logfile_count = 30 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86978) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] max_logfile_size_mb = 200 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] max_over_subscription_ratio = 20.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] message_reap_interval = 86400 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] message_ttl = 2592000 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] migration_create_volume_timeout_secs = 300 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] monkey_patch = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] monkey_patch_modules = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] my_ip = 192.168.122.208 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] no_snapshot_gb_quota = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] num_iser_scan_tries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] num_shell_tries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] num_volume_device_scan_tries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] nvmeof_conn_info_version = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] nvmet_ns_id = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] nvmet_port_id = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] osapi_max_limit = 1000 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] osapi_volume_ext_list = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] osapi_volume_listen_port = 8776 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] osapi_volume_use_ssl = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] osapi_volume_workers = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] per_volume_size_limit = -1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] periodic_fuzzy_delay = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] periodic_interval = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] public_endpoint = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] publish_errors = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] quota_backup_gigabytes = 1000 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] quota_backups = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] quota_gigabytes = 1000 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] quota_groups = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] quota_snapshots = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] quota_volumes = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] rate_limit_burst = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] rate_limit_except_level = CRITICAL {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] rate_limit_interval = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] reinit_driver_count = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] replication_device = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] report_discard_supported = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] report_interval = 120 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] reservation_clean_interval = 86400 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] reservation_expire = 86400 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] reserved_image_namespaces = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] reserved_percentage = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] rpc_response_timeout = 120 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] run_external_periodic_tasks = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] scst_target_driver = iscsi {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] scst_target_iqn_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_down_time = 720 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] shell_completion = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] snapshot_name_template = snapshot-%s {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] split_loggers = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] state_path = /opt/stack/data/cinder {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] storage_availability_zone = nova {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] storage_protocol = iSCSI {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] syslog_log_facility = LOG_USER {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] target_helper = lioadm {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] target_ip_address = 192.168.122.208 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] target_port = 3260 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] target_protocol = iscsi {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] target_secondary_ip_addresses = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] trace_flags = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] transport_url = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] until_refresh = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] use_chap_auth = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] use_default_quota_class = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] use_journal = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] use_json = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] use_multipath_for_image_xfer = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] use_stderr = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] use_syslog = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] verify_glance_signatures = enabled {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_api_class = cinder.volume.api.API {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_backend_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_clear = zero {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_clear_ionice = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_clear_size = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_copy_bps_limit = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_dd_blocksize = 1M {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_name_template = volume-%s {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_service_inithost_offload = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volume_usage_audit_period = month {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] zoning_mode = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_concurrency.disable_process_locking = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.auth_section = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.auth_type = password {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.auth_version = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.cache = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.include_service_catalog = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.insecure = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.interface = public {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_password = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86978) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcache_username = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.region_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.service_type = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.backend = dogpile.cache.null {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.backend_argument = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.backend_expiration_time = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.config_prefix = cache.oslo {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.debug_cache_backend = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.enable_retry_client = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.enable_socket_keepalive = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.expiration_time = 600 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.hashclient_retry_attempts = 2 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Running cmd (subprocess): mount.quobyte {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.memcache_dead_retry = 300 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.memcache_pool_maxsize = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.memcache_sasl_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.password = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.proxies = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.redis_db = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.redis_server = localhost:6379 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.retry_attempts = 2 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.retry_delay = 0.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.socket_keepalive_count = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.socket_keepalive_idle = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.socket_keepalive_interval = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.socket_timeout = 1.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.tls_allowed_ciphers = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.tls_cafile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.tls_certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.tls_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.tls_keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cache.username = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] coordination.backend_url = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.asyncio_connection = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.asyncio_slave_connection = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.backend = sqlalchemy {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.connection = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.connection_debug = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.connection_parameters = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.connection_recycle_time = 3600 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.connection_trace = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.db_inc_retry_interval = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.db_max_retries = 20 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.db_max_retry_interval = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.db_retry_interval = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.max_overflow = 50 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.max_pool_size = 5 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.max_retries = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.mysql_wsrep_sync_wait = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.pool_timeout = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.retry_interval = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.slave_connection = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.sqlite_synchronous = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.synchronous_reader = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] database.use_db_reconnect = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_tracing.insecure = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.connection_string = messaging:// {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.es_doc_type = notification {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.es_scroll_size = 10000 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.es_scroll_time = 2m {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.filter_error_trace = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.hmac_keys = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.sentinel_service_name = mymaster {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.socket_timeout = 0.1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.trace_requests = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler.trace_sqlalchemy = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler_jaeger.process_tags = {} {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler_jaeger.service_name_prefix = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] profiler_otlp.service_name_prefix = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.enforce_new_defaults = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.policy_default_rule = default {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.policy_file = policy.yaml {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] privsep_osbrick.group = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] privsep_osbrick.helper_command = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] privsep_osbrick.user = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_sys_admin.group = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_sys_admin.helper_command = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] cinder_sys_admin.user = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.auth_section = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.auth_type = password {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.cafile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.collect_timing = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.insecure = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.send_service_user_token = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.split_loggers = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.timeout = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.tls_ciphers = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] service_user.tls_min_version = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.auth_section = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.auth_type = password {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.collect_timing = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.insecure = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.region_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.split_loggers = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.timeout = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.tls_ciphers = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] glance.tls_min_version = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.backend_availability_zone = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.chap_password = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.chap_username = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.disk_geometry = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.driver_client_cert = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.driver_client_cert_key = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.driver_data_namespace = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.driver_use_ssl = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.extra_capabilities = {} {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.filter_function = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.goodness_function = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.iscsi_target_flags = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.iscsi_write_cache = on {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.iser_helper = tgtadm {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.iser_port = 3260 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack quobyte-client[86982]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_host = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_login = admin {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack quobyte-client[86982]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_mount_options = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_password = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_private_key = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_share_path = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.num_shell_tries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.quobyte_volume_url = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.replication_device = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.report_discard_supported = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.reserved_percentage = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.target_helper = tgtadm {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.target_port = 3260 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.target_protocol = iscsi {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.trace_flags = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.unique_fqdn_network = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.use_chap_auth = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_backend_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_clear = zero {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_clear_ionice = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_clear_size = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_reports.file_event_handler = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_reports.log_dir = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.backend_availability_zone = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.backend_host = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.chap_password = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.chap_username = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.chiscsi_conf = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.disk_geometry = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.driver_client_cert = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.driver_data_namespace = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.driver_use_ssl = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.extra_capabilities = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.filter_function = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.goodness_function = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.iser_helper = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.iser_ip_address = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.iser_port = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.iser_target_prefix = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_host = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_login = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_mount_options = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_password = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_private_key = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_share_path = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_ssh_port = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.num_shell_tries = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.nvmet_port_id = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.replication_device = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.report_discard_supported = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.reserved_percentage = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.scst_target_driver = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.storage_protocol = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.target_helper = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.target_ip_address = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.target_port = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.target_prefix = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.target_protocol = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.trace_flags = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.use_chap_auth = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_clear = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_clear_size = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] QuobyteHD.volumes_dir = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.ssl = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_notifications.driver = [] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_notifications.retry = -1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] key_manager.fixed_key = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.barbican_api_version = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.barbican_endpoint = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.barbican_endpoint_type = public {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.barbican_region_name = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.cafile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.collect_timing = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.insecure = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.number_of_retries = 60 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.retry_delay = 1 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.send_service_user_token = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.split_loggers = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.timeout = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.tls_ciphers = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.tls_min_version = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.verify_ssl = True {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican.verify_ssl_path = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.auth_section = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.auth_type = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.cafile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.certfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.collect_timing = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.insecure = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.keyfile = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.split_loggers = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.timeout = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.tls_ciphers = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] barbican_service_user.tls_min_version = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.approle_role_id = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.approle_secret_id = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.auth_method = approle {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.auth_path = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.kv_mountpoint = secret {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.kv_path = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.kv_version = 2 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.namespace = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.root_token_id = **** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.ssl_ca_crt_file = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.timeout = 60.0 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.token_file = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.token_role = None {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.use_ssl = False {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 14:19:46 devstack cinder-volume[86705]: DEBUG oslo_service.backend._eventlet.service [None req-7b0dd797-39b9-4602-a13d-4840a99a8763 None None] ******************************************************************************** {{(pid=86705) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 14:19:46 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.231s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:46 devstack cinder-volume[86978]: INFO cinder.volume.driver [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.driver [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8324928283691, 'free_capacity_gb': 1773.8324928283691, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86978) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_db.sqlalchemy.engines [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86978) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writer thread running {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.db.api [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Building query based on filter {{(pid=86978) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86978) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:46 devstack cinder-volume[86978]: INFO cinder.keymgr.migration [None req-cf4b03b5-56a6-46ca-93a5-79db6cb298d9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 14:19:46 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:19:46 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:46 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.230s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:19:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Driver initialization completed successfully. Nov 02 14:19:46 devstack cinder-volume[86978]: INFO cinder.manager [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Initiating service 3 cleanup Nov 02 14:19:46 devstack cinder-volume[86978]: INFO cinder.manager [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Service 3 cleanup completed. Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.service [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Creating RPC server for service cinder-volume {{(pid=86978) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.service [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86978) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 14:19:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:19:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:19:46 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:19:46 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:19:47 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Nov 02 14:19:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.232s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:19:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e3f89e21-9af3-4752-b7db-ce760e3fbc27 None None] Driver post RPC initialization completed successfully. Nov 02 14:19:55 devstack cinder-volume[86705]: DEBUG dbcounter [-] [86705] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86705) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:19:56 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:19:57 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:20:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:20:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 6 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:20:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Flow 'volume_create_manager' (063a70d8-0e9f-402e-a890-d98eef4f0720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832d526e-c627-42ab-9911-e855df1ddc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832d526e-c627-42ab-9911-e855df1ddc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-732203420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d463dc-3521-47e1-999a-02016787a2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0319ea4b36f74ab393c0b1f285609ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:21:04Z,use_quota=True,user_id='1ed16322dec047ccaff6e0702712143c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96007894-5ce2-4b63-8ad5-a85cfae07ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96007894-5ce2-4b63-8ad5-a85cfae07ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e764afb-523f-4fca-8c85-30110fba162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e764afb-523f-4fca-8c85-30110fba162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d463dc-3521-47e1-999a-02016787a2f9', 'volume_name': 'volume-b4d463dc-3521-47e1-999a-02016787a2f9', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb53eac-232b-4625-a3e7-0a466d5ab911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb53eac-232b-4625-a3e7-0a466d5ab911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5474b82-ba47-4d48-90a6-a733ae4917cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:04 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Volume b4d463dc-3521-47e1-999a-02016787a2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d463dc-3521-47e1-999a-02016787a2f9', 'volume_size': 1} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-732203420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d463dc-3521-47e1-999a-02016787a2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0319ea4b36f74ab393c0b1f285609ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:21:04Z,use_quota=True,user_id='1ed16322dec047ccaff6e0702712143c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Creating volume b4d463dc-3521-47e1-999a-02016787a2f9 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:21:04 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:21:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:05 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 1073741824 Nov 02 14:21:05 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:06 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 1073741824" returned: 0 in 1.798s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:06 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 Nov 02 14:21:06 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:07 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9" returned: 0 in 0.661s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] <== create_volume: return (2630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:21:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5474b82-ba47-4d48-90a6-a733ae4917cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d463dc-3521-47e1-999a-02016787a2f9', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4be33b-ca91-4efe-8bd5-d9e5eb18a9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:07 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Volume volume-b4d463dc-3521-47e1-999a-02016787a2f9 (b4d463dc-3521-47e1-999a-02016787a2f9): created successfully Nov 02 14:21:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4be33b-ca91-4efe-8bd5-d9e5eb18a9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Flow 'volume_create_manager' (063a70d8-0e9f-402e-a890-d98eef4f0720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:21:07 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-903f2879-6c50-44fa-85fb-7369f2cbbd9d tempest-DeleteServersTestJSON-813217113 None] Created volume successfully. Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Flow 'volume_create_manager' (fd7e1f20-dd25-4528-96fa-a25268a97a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce25f4ef-fc6b-4ff1-9452-b4d76ebf2562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce25f4ef-fc6b-4ff1-9452-b4d76ebf2562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-849169173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ba2c18-7b4b-41a7-98a1-272fc1cf356b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c2e27c75f14bfd835cde5758f50a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:21:16Z,use_quota=True,user_id='4a7d4a84c0e94b8393debb608641aa4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5e4c87-e812-41c9-be6b-b713de1206b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5e4c87-e812-41c9-be6b-b713de1206b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0793a871-f19f-4c7d-9203-6e5ad887545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0793a871-f19f-4c7d-9203-6e5ad887545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ba2c18-7b4b-41a7-98a1-272fc1cf356b', 'volume_name': 'volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e2bc43-ab2e-42c3-af6b-be132c35b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e2bc43-ab2e-42c3-af6b-be132c35b31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e544b04d-84ff-49c1-bf19-802896b53ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:16 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Volume c0ba2c18-7b4b-41a7-98a1-272fc1cf356b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b', 'volume_size': 1} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-849169173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ba2c18-7b4b-41a7-98a1-272fc1cf356b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c2e27c75f14bfd835cde5758f50a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:21:16Z,use_quota=True,user_id='4a7d4a84c0e94b8393debb608641aa4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Creating volume c0ba2c18-7b4b-41a7-98a1-272fc1cf356b {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:21:16 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:16 devstack cinder-volume[86978]: WARNING py.warnings [req-9ac52897-1271-46ee-910d-9acb0dc21541 req-d41e37ec-17e5-409b-aaf5-234288d65c12 tempest-DeleteServersTestJSON-813217113 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 02 14:21:16 devstack cinder-volume[86978]: .first() Nov 02 14:21:16 devstack cinder-volume[86978]: Nov 02 14:21:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-9ac52897-1271-46ee-910d-9acb0dc21541 req-d41e37ec-17e5-409b-aaf5-234288d65c12 tempest-DeleteServersTestJSON-813217113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:16 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b 1073741824 Nov 02 14:21:16 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:17 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b 1073741824" returned: 0 in 1.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:17 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b Nov 02 14:21:17 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:18 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b" returned: 0 in 0.482s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-9ac52897-1271-46ee-910d-9acb0dc21541 req-d41e37ec-17e5-409b-aaf5-234288d65c12 tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.681s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e544b04d-84ff-49c1-bf19-802896b53ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0c7677-c45c-47a2-8f49-dccc947e566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Volume volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b (c0ba2c18-7b4b-41a7-98a1-272fc1cf356b): created successfully Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0c7677-c45c-47a2-8f49-dccc947e566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Flow 'volume_create_manager' (fd7e1f20-dd25-4528-96fa-a25268a97a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-9ac52897-1271-46ee-910d-9acb0dc21541 req-d41e37ec-17e5-409b-aaf5-234288d65c12 tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.243s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e174fac6-a030-4b07-9005-6dabe7842a58 tempest-VolumesAdminNegativeTest-160818759 None] Created volume successfully. Nov 02 14:21:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-9ac52897-1271-46ee-910d-9acb0dc21541 req-d41e37ec-17e5-409b-aaf5-234288d65c12 tempest-DeleteServersTestJSON-813217113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-b4d463dc-3521-47e1-999a-02016787a2f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a248d0f8-2fcf-44cf-9b7c-ef80df9538d2', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:21:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-9ac52897-1271-46ee-910d-9acb0dc21541 req-d41e37ec-17e5-409b-aaf5-234288d65c12 tempest-DeleteServersTestJSON-813217113 None] attachment_update completed successfully. Nov 02 14:21:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Acquiring lock "cinder-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Lock "cinder-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Acquiring lock "cinder-quobyte-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Flow 'volume_create_manager' (4b67f3a6-0a5c-46e2-a3c8-329dd118ab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba06f987-cdcf-4ff3-b339-1c990da3e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Lock "cinder-quobyte-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b" acquired by "delete_volume" :: waited 0.076s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:21:21 devstack cinder-volume[86978]: INFO oslo.privsep.daemon [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbcps9yrg/privsep.sock'] Nov 02 14:21:21 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbcps9yrg/privsep.sock Nov 02 14:21:21 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba06f987-cdcf-4ff3-b339-1c990da3e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-335899086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e41377-8f22-4cbd-bd5f-83a93d52ca4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26324ac8e4f649c1bec8a93a32db001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:21:21Z,use_quota=True,user_id='0834d38ea46b4903854ed4b3e756057a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9135a034-a91e-4133-bf31-25a09f423cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9135a034-a91e-4133-bf31-25a09f423cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceea227f-5d5b-48cc-85a1-e57f554829b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceea227f-5d5b-48cc-85a1-e57f554829b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e41377-8f22-4cbd-bd5f-83a93d52ca4e', 'volume_name': 'volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca65708-a86f-4e9f-8a5f-0d7063402bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca65708-a86f-4e9f-8a5f-0d7063402bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e380935-baa8-4d19-90d8-80a71f353db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:21 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Volume d1e41377-8f22-4cbd-bd5f-83a93d52ca4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e', 'volume_size': 1} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-335899086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e41377-8f22-4cbd-bd5f-83a93d52ca4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26324ac8e4f649c1bec8a93a32db001a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:21:21Z,use_quota=True,user_id='0834d38ea46b4903854ed4b3e756057a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Creating volume d1e41377-8f22-4cbd-bd5f-83a93d52ca4e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:21:21 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:21:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:21 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e 1073741824 Nov 02 14:21:21 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:22 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e 1073741824" returned: 0 in 1.200s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:22 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e Nov 02 14:21:22 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 14:21:23 devstack cinder-volume[86978]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 14:21:23 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e" returned: 0 in 0.832s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e380935-baa8-4d19-90d8-80a71f353db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25472cc3-e376-4a0e-b146-8b726e61266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:21:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Volume volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e (d1e41377-8f22-4cbd-bd5f-83a93d52ca4e): created successfully Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25472cc3-e376-4a0e-b146-8b726e61266f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:21:23 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Flow 'volume_create_manager' (4b67f3a6-0a5c-46e2-a3c8-329dd118ab90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:21:23 devstack cinder-volume[86978]: INFO oslo.privsep.daemon [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Spawned new privsep daemon via rootwrap Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Accepted privsep connection to /tmp/tmpbcps9yrg/privsep.sock {{(pid=86978) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 14:21:23 devstack cinder-volume[86978]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 14:21:23 devstack cinder-volume[86978]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 14:21:23 devstack cinder-volume[86978]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 14:21:23 devstack cinder-volume[86978]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88590 Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec482ca-38a2-4824-af28-61b0d892ee71]: (2,) {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:21:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-82fa114e-470a-46d9-85ae-c91d3b9627f7 tempest-ServerRescueNegativeTestJSON-754553118 None] Created volume successfully. Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbd3c07-f70e-41be-ab12-62a5eef5765c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:21:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:24 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b Nov 02 14:21:24 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:25 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b" returned: 0 in 1.199s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:25 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b Nov 02 14:21:25 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:25 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b" returned: 0 in 0.855s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Lock "cinder-quobyte-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b" released by "delete_volume" :: held 4.750s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:21:26 devstack cinder-volume[86978]: WARNING cinder.quota [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:21:26 devstack cinder-volume[86978]: WARNING cinder.quota [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Created reservations ['017c04a7-6e7d-4343-98c4-2aa9bebde1ef', '784cafc4-459a-4e11-932a-4bc418631057', '1f3421a3-d56e-4382-8f2d-c59386a06bf6', '05df712c-f17a-4323-9702-b18b449185ff'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:26 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:21:26 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:26 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.556s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:26 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:21:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Deleted volume successfully. Nov 02 14:21:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9c15bc33-ec6f-41bf-a667-ad8ed988cbd7 tempest-VolumesAdminNegativeTest-160818759 None] Lock "cinder-c0ba2c18-7b4b-41a7-98a1-272fc1cf356b-delete_volume" released by "delete_volume" :: held 6.032s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:21:27 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-3731061d-34d4-44bc-abce-37791111efdf req-3d967560-8a19-43ea-9c52-a7524d5f06ac tempest-DeleteServersTestJSON-813217113 None] Terminate volume connection completed successfully. Nov 02 14:21:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-3731061d-34d4-44bc-abce-37791111efdf req-3d967560-8a19-43ea-9c52-a7524d5f06ac tempest-DeleteServersTestJSON-813217113 None] Deleting attachment a248d0f8-2fcf-44cf-9b7c-ef80df9538d2. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:21:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Acquiring lock "cinder-b4d463dc-3521-47e1-999a-02016787a2f9-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:21:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Lock "cinder-b4d463dc-3521-47e1-999a-02016787a2f9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:21:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Acquiring lock "cinder-quobyte-b4d463dc-3521-47e1-999a-02016787a2f9" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:21:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Lock "cinder-quobyte-b4d463dc-3521-47e1-999a-02016787a2f9" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:21:31 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da93276-9b60-4710-a0a1-7a55a4f42cd2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:21:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:31 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 Nov 02 14:21:31 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:32 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9" returned: 0 in 1.024s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:32 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9 Nov 02 14:21:32 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:32 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b4d463dc-3521-47e1-999a-02016787a2f9" returned: 0 in 0.362s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Lock "cinder-quobyte-b4d463dc-3521-47e1-999a-02016787a2f9" released by "delete_volume" :: held 1.494s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:21:32 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Created reservations ['fec89f9f-fb74-4837-9462-a1a0b9c7e897', '5d1f3c45-acfe-4e65-9640-3e7ce2acca61', '25199a84-620a-4748-91f6-fa79eba3dca7', '6bd35aa2-63fe-4836-ac7b-b9480b441e36'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:33 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:21:33 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:33 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.342s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:21:33 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Deleted volume successfully. Nov 02 14:21:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c2f678a-032e-44e2-ac27-c9e624022c44 tempest-DeleteServersTestJSON-813217113 None] Lock "cinder-b4d463dc-3521-47e1-999a-02016787a2f9-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:39 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:21:39 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:39 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.400s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 8 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:21:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:21:43 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=23,cinder:UPDATE=30,cinder:DELETE=1,cinder:INSERT=5 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:21:43 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=23,cinder:INSERT=6,cinder:SELECT=24,cinder:DELETE=4 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Acquiring lock "cinder-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "cinder-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Acquiring lock "cinder-quobyte-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "cinder-quobyte-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d566118-e98f-440a-b37d-d41ea0d13272]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:53 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e Nov 02 14:21:53 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:53 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e" returned: 0 in 0.517s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:53 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e Nov 02 14:21:53 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:54 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e" returned: 0 in 0.296s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "cinder-quobyte-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e" released by "delete_volume" :: held 0.891s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Created reservations ['d98e90ad-c488-4007-ab31-7f3e3664bfbc', '70d6a7ae-a842-4701-8663-fcfce369e149', '75297e8c-f08d-445d-8539-30baea62c490', '9b7ad77f-74d9-4f08-9590-784eed07943e'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:21:54 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:21:54 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:21:54 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.436s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:21:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Deleted volume successfully. Nov 02 14:21:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e53598c-0a0c-40ba-adac-65834f39ed7b tempest-ServerRescueNegativeTestJSON-754553118 None] Lock "cinder-d1e41377-8f22-4cbd-bd5f-83a93d52ca4e-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:22:04 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:22:04 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:22:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1393212a-e6fb-4559-b4c3-2be7663ff750 tempest-BackendsCapabilitiesAdminTestsJSON-2069904936 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8324928283691, 'free_capacity_gb': 1773.8324928283691, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86978) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 14:22:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-03f9009d-8f9e-4e7a-80f6-ff90c18ab599 tempest-BackendsCapabilitiesAdminTestsJSON-2069904936 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8324928283691, 'free_capacity_gb': 1773.8324928283691, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86978) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Flow 'volume_create_manager' (fa566c04-6832-4a62-8e4e-e46f6e187f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c58aac-46ef-4e4d-9d32-c46c1b8396ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c58aac-46ef-4e4d-9d32-c46c1b8396ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-108920327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb858f0fc6764790b91cba73109eb8ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:22:22Z,use_quota=True,user_id='2a813b2d78dc48f2b3ae20a57379f231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6e98c0-c684-4ab2-a2f0-86ee472f1f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6e98c0-c684-4ab2-a2f0-86ee472f1f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a76653-b852-4824-b696-6741fd8b7363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a76653-b852-4824-b696-6741fd8b7363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc', 'volume_name': 'volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad774265-54e2-4a25-a7bd-efa44eb2a0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad774265-54e2-4a25-a7bd-efa44eb2a0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c71e5f9-082e-41e8-a184-f499399b13aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Volume 7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc', 'volume_size': 1} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-108920327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb858f0fc6764790b91cba73109eb8ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:22:22Z,use_quota=True,user_id='2a813b2d78dc48f2b3ae20a57379f231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Creating volume 7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:22:22 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:22:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:22:22 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc 1073741824 Nov 02 14:22:22 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:22:23 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Nov 02 14:22:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc 1073741824" returned: 0 in 0.789s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:22:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:22:23 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc Nov 02 14:22:23 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:22:23 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Nov 02 14:22:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:22:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:22:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:22:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c71e5f9-082e-41e8-a184-f499399b13aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48a9504-c7e0-48bf-927c-619c73442c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:24 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Volume volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc (7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc): created successfully Nov 02 14:22:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48a9504-c7e0-48bf-927c-619c73442c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Flow 'volume_create_manager' (fa566c04-6832-4a62-8e4e-e46f6e187f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:22:24 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5a07a6ab-d806-4075-80fe-209506ab7074 tempest-TaggedAttachmentsTest-268924147 None] Created volume successfully. Nov 02 14:22:34 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:22:34 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:22:39 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:22:39 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:22:39 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.557s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:22:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Flow 'volume_create_manager' (037c9955-1958-49b9-9ed3-0eff8c05f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b484118a-78e3-464a-8664-6fe9c084620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b484118a-78e3-464a-8664-6fe9c084620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-626923551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad03c521a8dd411d9c7eda05b15c97f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:22:42Z,use_quota=True,user_id='040fa151bf2e46499a67b4f0c7dc9119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ed518-1710-4bbe-8012-0777d9c1e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ed518-1710-4bbe-8012-0777d9c1e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511092b8-bc33-4628-af92-4a104ff654c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511092b8-bc33-4628-af92-4a104ff654c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3', 'volume_name': 'volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce21fc46-fe4e-4445-bd03-0e92a75d55c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce21fc46-fe4e-4445-bd03-0e92a75d55c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a636b23-c227-4650-9859-8b92d9aee8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Volume c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3', 'volume_size': 1} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-626923551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad03c521a8dd411d9c7eda05b15c97f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:22:42Z,use_quota=True,user_id='040fa151bf2e46499a67b4f0c7dc9119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Creating volume c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:22:42 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:22:42 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 1073741824 Nov 02 14:22:42 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:22:42 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 1073741824" returned: 0 in 0.710s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:22:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:22:42 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 Nov 02 14:22:42 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:22:43 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Nov 02 14:22:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3" returned: 0 in 0.506s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:22:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:22:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:22:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a636b23-c227-4650-9859-8b92d9aee8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542a10f0-5b42-4b35-828a-cedd3b02d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Volume volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 (c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3): created successfully Nov 02 14:22:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542a10f0-5b42-4b35-828a-cedd3b02d212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Flow 'volume_create_manager' (037c9955-1958-49b9-9ed3-0eff8c05f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:22:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2eab1bed-e352-44e3-bf81-7f83c8951362 tempest-ServerActionsTestOtherA-608641562 None] Created volume successfully. Nov 02 14:22:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f001a998-1449-4951-9696-b615d5b05122 tempest-GroupsTest-57938585 None] Group tempest-Group1-2009230359: creating Nov 02 14:22:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f001a998-1449-4951-9696-b615d5b05122 tempest-GroupsTest-57938585 None] Group tempest-Group1-2009230359: created successfully Nov 02 14:22:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f001a998-1449-4951-9696-b615d5b05122 tempest-GroupsTest-57938585 None] Create group completed successfully. Nov 02 14:22:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1885c348-ea73-456c-868b-49b0780af02a tempest-GroupsTest-57938585 None] Group tempest-Group2-323757993: creating Nov 02 14:22:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1885c348-ea73-456c-868b-49b0780af02a tempest-GroupsTest-57938585 None] Group tempest-Group2-323757993: created successfully Nov 02 14:22:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1885c348-ea73-456c-868b-49b0780af02a tempest-GroupsTest-57938585 None] Create group completed successfully. Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Flow 'volume_create_manager' (b8eac7e7-6cc8-42c0-b081-f57b1be71e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18efcac-7a2e-469c-8866-6fc0bf73af2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18efcac-7a2e-469c-8866-6fc0bf73af2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800173304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac8d3d47-2960-4dee-ba49-7d2886a3fdf8,host='devstack@QuobyteHD#QuobyteHD',id=b20ddb4e-f460-4f5b-be1a-7e1b1050e511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480fb9aa6f2c46cdb7ce7ef68fbb19bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:22:57Z,use_quota=True,user_id='473fbbc36632486286514d9a1bc3952a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb403da9-44c8-4f7a-b111-6986b3c678f2),volume_type_id=cb403da9-44c8-4f7a-b111-6986b3c678f2)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0192dc5c-90f1-4d51-be15-4683cda189ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0192dc5c-90f1-4d51-be15-4683cda189ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddee06b-8da2-41a1-9f40-d67593cd0d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddee06b-8da2-41a1-9f40-d67593cd0d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20ddb4e-f460-4f5b-be1a-7e1b1050e511', 'volume_name': 'volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e2f2a2-1b09-4cdb-bd1d-86ad1d7e4a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e2f2a2-1b09-4cdb-bd1d-86ad1d7e4a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6f8b43-34fe-45fd-ad77-f708c4800cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:57 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Volume b20ddb4e-f460-4f5b-be1a-7e1b1050e511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511', 'volume_size': 1} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ac8d3d47-2960-4dee-ba49-7d2886a3fdf8,created_at=2026-11-02T13:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-800173304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac8d3d47-2960-4dee-ba49-7d2886a3fdf8,host='devstack@QuobyteHD#QuobyteHD',id=b20ddb4e-f460-4f5b-be1a-7e1b1050e511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480fb9aa6f2c46cdb7ce7ef68fbb19bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:22:57Z,use_quota=True,user_id='473fbbc36632486286514d9a1bc3952a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb403da9-44c8-4f7a-b111-6986b3c678f2),volume_type_id=cb403da9-44c8-4f7a-b111-6986b3c678f2)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Creating volume b20ddb4e-f460-4f5b-be1a-7e1b1050e511 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:22:57 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:22:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:22:57 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 1073741824 Nov 02 14:22:57 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:22:58 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 1073741824" returned: 0 in 0.616s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:22:58 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 Nov 02 14:22:58 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:22:58 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511" returned: 0 in 0.297s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6f8b43-34fe-45fd-ad77-f708c4800cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8c3a80-f442-420a-abcf-e6f4ba52cd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:22:58 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Volume volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 (b20ddb4e-f460-4f5b-be1a-7e1b1050e511): created successfully Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8c3a80-f442-420a-abcf-e6f4ba52cd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:22:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Flow 'volume_create_manager' (b8eac7e7-6cc8-42c0-b081-f57b1be71e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:22:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2015fd20-8b99-4f8b-8c80-89e8787a6925 tempest-GroupsTest-57938585 None] Created volume successfully. Nov 02 14:23:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Acquiring lock "cinder-quobyte-b20ddb4e-f460-4f5b-be1a-7e1b1050e511" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:23:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Lock "cinder-quobyte-b20ddb4e-f460-4f5b-be1a-7e1b1050e511" acquired by "delete_volume" :: waited 0.044s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:23:01 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32f53a3-fc88-4a8e-902b-c28938a7c9d8]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:23:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:01 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 Nov 02 14:23:01 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:01 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511" returned: 0 in 0.536s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:02 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511 Nov 02 14:23:02 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:02 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b20ddb4e-f460-4f5b-be1a-7e1b1050e511" returned: 0 in 0.415s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Lock "cinder-quobyte-b20ddb4e-f460-4f5b-be1a-7e1b1050e511" released by "delete_volume" :: held 1.055s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Created reservations ['3f833d37-8529-4a81-8b4a-48f5ad2aeccc'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:02 devstack cinder-volume[86978]: WARNING cinder.quota [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-319726433 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-319726433, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:23:02 devstack cinder-volume[86978]: WARNING cinder.quota [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-319726433 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-319726433, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Created reservations ['93d7037c-bdd4-425d-8e61-00667b5aeeb8', 'f96fd24e-ddad-4d95-bf6d-b9499bf1b808', '929a47a0-f8ff-4878-a0c5-6146f632a7bb', '2c5064f9-237b-4afb-b8ff-68d229112c56'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:02 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:23:02 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Created reservations ['bb67cb22-a632-4311-bf6d-26c66769b208'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:03 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:23:03 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:03 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.718s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:23:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b13a0c31-c13b-4c37-a2ce-cded4ecf3559 tempest-GroupsTest-57938585 None] Delete group completed successfully. Nov 02 14:23:03 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.507s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:03 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:23:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-38d4465c-7f72-4d19-9355-b141312564f3 tempest-GroupsTest-57938585 None] Delete group completed successfully. Nov 02 14:23:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1c44b825-1cc4-4b46-9497-8f96cf4c6be7 tempest-GroupsTest-57938585 None] Group tempest-GroupsTest-Group-1717057315: creating Nov 02 14:23:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1c44b825-1cc4-4b46-9497-8f96cf4c6be7 tempest-GroupsTest-57938585 None] Group tempest-GroupsTest-Group-1717057315: created successfully Nov 02 14:23:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1c44b825-1cc4-4b46-9497-8f96cf4c6be7 tempest-GroupsTest-57938585 None] Create group completed successfully. Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Flow 'volume_create_manager' (90a5cb66-3283-4490-b750-c46f6896d8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4489b971-5764-442b-9867-01a531e24458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4489b971-5764-442b-9867-01a531e24458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038177355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff54f41e-e5d2-4b3f-b322-8e9a32cd5efa,host='devstack@QuobyteHD#QuobyteHD',id=1698ce70-8b04-4494-bcfd-934800e8b9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480fb9aa6f2c46cdb7ce7ef68fbb19bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:06Z,use_quota=True,user_id='473fbbc36632486286514d9a1bc3952a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b35ecbd-a381-4222-977b-a028ddc8fa51),volume_type_id=5b35ecbd-a381-4222-977b-a028ddc8fa51)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436335b1-049c-478d-b0c1-f60d6e76695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436335b1-049c-478d-b0c1-f60d6e76695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067ae5c3-aec5-4489-b745-0a9a0dec561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067ae5c3-aec5-4489-b745-0a9a0dec561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1698ce70-8b04-4494-bcfd-934800e8b9e6', 'volume_name': 'volume-1698ce70-8b04-4494-bcfd-934800e8b9e6', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cf3313-60f8-4ad8-af92-6ebe0987b41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cf3313-60f8-4ad8-af92-6ebe0987b41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232b7b40-e18f-49d8-9d4f-ef2576ffa909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:06 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Volume 1698ce70-8b04-4494-bcfd-934800e8b9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1698ce70-8b04-4494-bcfd-934800e8b9e6', 'volume_size': 1} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff54f41e-e5d2-4b3f-b322-8e9a32cd5efa,created_at=2026-11-02T13:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2038177355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff54f41e-e5d2-4b3f-b322-8e9a32cd5efa,host='devstack@QuobyteHD#QuobyteHD',id=1698ce70-8b04-4494-bcfd-934800e8b9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480fb9aa6f2c46cdb7ce7ef68fbb19bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:06Z,use_quota=True,user_id='473fbbc36632486286514d9a1bc3952a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b35ecbd-a381-4222-977b-a028ddc8fa51),volume_type_id=5b35ecbd-a381-4222-977b-a028ddc8fa51)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Creating volume 1698ce70-8b04-4494-bcfd-934800e8b9e6 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:23:06 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:06 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 1073741824 Nov 02 14:23:06 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:06 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 1073741824" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:07 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 Nov 02 14:23:07 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:07 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6" returned: 0 in 0.254s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232b7b40-e18f-49d8-9d4f-ef2576ffa909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1698ce70-8b04-4494-bcfd-934800e8b9e6', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e87863-8e4d-4fe4-b44b-7d2001c75b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:07 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Volume volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 (1698ce70-8b04-4494-bcfd-934800e8b9e6): created successfully Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e87863-8e4d-4fe4-b44b-7d2001c75b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Flow 'volume_create_manager' (90a5cb66-3283-4490-b750-c46f6896d8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:07 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-95cb612d-340d-411c-8ec3-5567c5913c14 tempest-GroupsTest-57938585 None] Created volume successfully. Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Flow 'volume_create_manager' (09d46b4f-d318-42bb-93d5-95b924519af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7dfee9-8e40-4794-8fc2-c69158eb1fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7dfee9-8e40-4794-8fc2-c69158eb1fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1697452917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff54f41e-e5d2-4b3f-b322-8e9a32cd5efa,host='devstack@QuobyteHD#QuobyteHD',id=8542e81b-47da-49fc-bd18-86c6f01236a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480fb9aa6f2c46cdb7ce7ef68fbb19bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:08Z,use_quota=True,user_id='473fbbc36632486286514d9a1bc3952a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b35ecbd-a381-4222-977b-a028ddc8fa51),volume_type_id=5b35ecbd-a381-4222-977b-a028ddc8fa51)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1afc90-c5b5-4cf9-9b0f-418fddc4e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1afc90-c5b5-4cf9-9b0f-418fddc4e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d0842e-c53e-418d-9110-01d01bb8b442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d0842e-c53e-418d-9110-01d01bb8b442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8542e81b-47da-49fc-bd18-86c6f01236a5', 'volume_name': 'volume-8542e81b-47da-49fc-bd18-86c6f01236a5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153e5e48-d8ec-457c-9f26-607bfcc3c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153e5e48-d8ec-457c-9f26-607bfcc3c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20ba1ce-b345-4cf4-8e35-adbe121b405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:08 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Volume 8542e81b-47da-49fc-bd18-86c6f01236a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8542e81b-47da-49fc-bd18-86c6f01236a5', 'volume_size': 1} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ff54f41e-e5d2-4b3f-b322-8e9a32cd5efa,created_at=2026-11-02T13:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1697452917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ff54f41e-e5d2-4b3f-b322-8e9a32cd5efa,host='devstack@QuobyteHD#QuobyteHD',id=8542e81b-47da-49fc-bd18-86c6f01236a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480fb9aa6f2c46cdb7ce7ef68fbb19bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:08Z,use_quota=True,user_id='473fbbc36632486286514d9a1bc3952a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b35ecbd-a381-4222-977b-a028ddc8fa51),volume_type_id=5b35ecbd-a381-4222-977b-a028ddc8fa51)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Creating volume 8542e81b-47da-49fc-bd18-86c6f01236a5 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:23:08 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:08 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 1073741824 Nov 02 14:23:08 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:08 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 1073741824" returned: 0 in 0.459s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:08 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 Nov 02 14:23:08 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:09 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:23:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20ba1ce-b345-4cf4-8e35-adbe121b405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8542e81b-47da-49fc-bd18-86c6f01236a5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84defac0-8421-4962-845e-da42027624cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:09 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Volume volume-8542e81b-47da-49fc-bd18-86c6f01236a5 (8542e81b-47da-49fc-bd18-86c6f01236a5): created successfully Nov 02 14:23:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84defac0-8421-4962-845e-da42027624cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Flow 'volume_create_manager' (09d46b4f-d318-42bb-93d5-95b924519af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b5f2afcf-9923-414d-ba05-054572e79df3 tempest-GroupsTest-57938585 None] Created volume successfully. Nov 02 14:23:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-399d481e-ea74-40c1-a25b-60953f3823ee tempest-GroupsTest-57938585 None] Update group completed successfully. Nov 02 14:23:11 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-24245f92-8d27-4be1-a075-3990d4358bdd tempest-GroupsTest-57938585 None] Update group completed successfully. Nov 02 14:23:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Acquiring lock "cinder-quobyte-1698ce70-8b04-4494-bcfd-934800e8b9e6" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:23:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Lock "cinder-quobyte-1698ce70-8b04-4494-bcfd-934800e8b9e6" acquired by "delete_volume" :: waited 0.047s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:23:13 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a050085-cf9f-438e-a460-128fb23c40c1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:23:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:14 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 Nov 02 14:23:14 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:14 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6" returned: 0 in 0.684s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:14 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6 Nov 02 14:23:14 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:14 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1698ce70-8b04-4494-bcfd-934800e8b9e6" returned: 0 in 0.283s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Lock "cinder-quobyte-1698ce70-8b04-4494-bcfd-934800e8b9e6" released by "delete_volume" :: held 1.081s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Acquiring lock "cinder-quobyte-8542e81b-47da-49fc-bd18-86c6f01236a5" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Lock "cinder-quobyte-8542e81b-47da-49fc-bd18-86c6f01236a5" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Flow 'volume_create_manager' (a74a94e9-74b0-44cb-a57f-25688adb5cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb45a54c-3ffe-4ae4-9079-1271e3f4f6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a45b46b-d312-4c44-b789-fa99a82080ac]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb45a54c-3ffe-4ae4-9079-1271e3f4f6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1784678585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c1ed9c-df7b-48cc-b92e-b56db48ab73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac97d315bf5941419ca62a07286c6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:15Z,use_quota=True,user_id='b3b0191c5e0f4577a6015274b493a5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0eb08a-8367-4525-89eb-05de8322365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0eb08a-8367-4525-89eb-05de8322365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b855daf5-9a8b-48e0-a52c-56b15ae13fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b855daf5-9a8b-48e0-a52c-56b15ae13fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c1ed9c-df7b-48cc-b92e-b56db48ab73b', 'volume_name': 'volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2fa932-726a-4e69-9363-4fdb2e0cc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2fa932-726a-4e69-9363-4fdb2e0cc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c46dcf-5243-45c9-936c-1d99063cc574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:14 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Volume 74c1ed9c-df7b-48cc-b92e-b56db48ab73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b', 'volume_size': 1} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1784678585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c1ed9c-df7b-48cc-b92e-b56db48ab73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac97d315bf5941419ca62a07286c6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:15Z,use_quota=True,user_id='b3b0191c5e0f4577a6015274b493a5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Creating volume 74c1ed9c-df7b-48cc-b92e-b56db48ab73b {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:23:14 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:23:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:14 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b 1073741824 Nov 02 14:23:14 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:14 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 Nov 02 14:23:14 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:15 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5" returned: 0 in 0.452s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:15 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5 Nov 02 14:23:15 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-cc6bf6a1-5ab0-4bc0-a945-938be872ecf6 req-08b3aba9-6d88-4c2f-9e48-d97ce753c675 tempest-TaggedAttachmentsTest-268924147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:15 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b 1073741824" returned: 0 in 0.533s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:15 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b Nov 02 14:23:15 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:15 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8542e81b-47da-49fc-bd18-86c6f01236a5" returned: 0 in 0.276s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Lock "cinder-quobyte-8542e81b-47da-49fc-bd18-86c6f01236a5" released by "delete_volume" :: held 0.808s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Created reservations ['fd73eea0-62df-4def-a27e-b7c4af03268e'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:15 devstack cinder-volume[86978]: WARNING cinder.quota [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1862244240 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1862244240, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:23:15 devstack cinder-volume[86978]: WARNING cinder.quota [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1862244240 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1862244240, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Created reservations ['dfc90e41-ebac-41b3-9790-553581552c3c', '4c9a12d6-afd5-4eff-8622-7d5b3f8e1296', '92c7b00b-6f57-4056-85fd-c176708718a4', '7a849d72-7762-4859-a175-b7a28e535da4'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:15 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b" returned: 0 in 0.267s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-cc6bf6a1-5ab0-4bc0-a945-938be872ecf6 req-08b3aba9-6d88-4c2f-9e48-d97ce753c675 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.359s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c46dcf-5243-45c9-936c-1d99063cc574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151757e6-d357-4b0a-93a7-669de0e6632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Volume volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b (74c1ed9c-df7b-48cc-b92e-b56db48ab73b): created successfully Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151757e6-d357-4b0a-93a7-669de0e6632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Flow 'volume_create_manager' (a74a94e9-74b0-44cb-a57f-25688adb5cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-cc6bf6a1-5ab0-4bc0-a945-938be872ecf6 req-08b3aba9-6d88-4c2f-9e48-d97ce753c675 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.115s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-bc9b7d7a-fd0e-4c1a-9641-5475d26179ab tempest-AttachVolumeNegativeTest-789012110 None] Created volume successfully. Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Created reservations ['49f8ae22-75e7-4d1c-ba58-26bd053a40dd', '193f0d0f-12b8-49be-a2e9-48adac9639c8', 'b37bcf22-c2e3-4539-ae81-25b5bb0c8e74', '1118f3b0-7530-49c8-8f42-8496884c584a'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-cc6bf6a1-5ab0-4bc0-a945-938be872ecf6 req-08b3aba9-6d88-4c2f-9e48-d97ce753c675 tempest-TaggedAttachmentsTest-268924147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fcd89a3-9676-4cba-be67-f326aa95b0ee', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:23:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-cc6bf6a1-5ab0-4bc0-a945-938be872ecf6 req-08b3aba9-6d88-4c2f-9e48-d97ce753c675 tempest-TaggedAttachmentsTest-268924147 None] attachment_update completed successfully. Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:16 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:23:16 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:16 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.309s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:16 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:23:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b03caab6-6176-44a9-ac5c-729e42a3358e tempest-GroupsTest-57938585 None] Delete group completed successfully. Nov 02 14:23:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-3884bc1c-bc90-475a-a8ec-42d3e8c1ec6a req-b017d474-55d9-41ad-ad5e-bd0bbadf0b1a tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-3884bc1c-bc90-475a-a8ec-42d3e8c1ec6a req-b017d474-55d9-41ad-ad5e-bd0bbadf0b1a tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-3884bc1c-bc90-475a-a8ec-42d3e8c1ec6a req-b017d474-55d9-41ad-ad5e-bd0bbadf0b1a tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-3884bc1c-bc90-475a-a8ec-42d3e8c1ec6a req-b017d474-55d9-41ad-ad5e-bd0bbadf0b1a tempest-AttachVolumeNegativeTest-789012110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5552d460-3068-4aa7-97c4-51a4ac5808aa', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:23:17 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-3884bc1c-bc90-475a-a8ec-42d3e8c1ec6a req-b017d474-55d9-41ad-ad5e-bd0bbadf0b1a tempest-AttachVolumeNegativeTest-789012110 None] attachment_update completed successfully. Nov 02 14:23:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-8457e1a3-9593-4bdb-84c5-e96dc542f9c3 req-07d90cfc-b17e-44fe-b528-2eb7dbc0e22a tempest-TaggedAttachmentsTest-268924147 None] Terminate volume connection completed successfully. Nov 02 14:23:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8457e1a3-9593-4bdb-84c5-e96dc542f9c3 req-07d90cfc-b17e-44fe-b528-2eb7dbc0e22a tempest-TaggedAttachmentsTest-268924147 None] Deleting attachment 0fcd89a3-9676-4cba-be67-f326aa95b0ee. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:23:28 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=70,cinder:INSERT=10,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:23:28 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=49,cinder:DELETE=3,cinder:SELECT=48,cinder:INSERT=10 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:23:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Acquiring lock "cinder-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:23:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Lock "cinder-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:23:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Acquiring lock "cinder-quobyte-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:23:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Lock "cinder-quobyte-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:23:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[796aec4f-35a1-4f30-b22b-6bb60956ebfc]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:23:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:30 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc Nov 02 14:23:30 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:30 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc" returned: 0 in 0.671s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:30 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc Nov 02 14:23:30 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:31 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc" returned: 0 in 0.391s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Lock "cinder-quobyte-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc" released by "delete_volume" :: held 1.136s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Created reservations ['2f51e71c-98ad-45ba-8016-09dadddc1bf1', '1df76cba-722f-4a8b-a41c-dbd9e2b68338', '240bc97e-5068-4fe5-baaa-ba3e123b79c2', '21cdf079-08f3-4de8-8346-8985748a86e1'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:31 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:23:31 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:31 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.404s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:23:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Deleted volume successfully. Nov 02 14:23:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-113e326b-4c16-4ef8-881d-185d6fa391b4 tempest-TaggedAttachmentsTest-268924147 None] Lock "cinder-7fbd5a73-b221-4a4e-8c2e-2caa6e651bfc-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:23:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-867626e3-8617-45ab-a322-c4e980ffe406 req-7f513742-6336-47d6-87ce-da7b6ae05aef tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-867626e3-8617-45ab-a322-c4e980ffe406 req-7f513742-6336-47d6-87ce-da7b6ae05aef tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-867626e3-8617-45ab-a322-c4e980ffe406 req-7f513742-6336-47d6-87ce-da7b6ae05aef tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-867626e3-8617-45ab-a322-c4e980ffe406 req-7f513742-6336-47d6-87ce-da7b6ae05aef tempest-ServerActionsTestOtherA-608641562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b48056c1-e25c-4339-9ae9-6c449383a5ca', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:23:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-867626e3-8617-45ab-a322-c4e980ffe406 req-7f513742-6336-47d6-87ce-da7b6ae05aef tempest-ServerActionsTestOtherA-608641562 None] attachment_update completed successfully. Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:39 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:23:39 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:39 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.657s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 8 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:23:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Flow 'volume_create_manager' (93b27dd1-4c2e-4a68-b998-ecd2412cf65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cdddc5-c55a-413f-a480-75c5103b7f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9cdddc5-c55a-413f-a480-75c5103b7f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-581993086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5873b619-d6dc-4c8b-ab9d-89eaf56669cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4d042b0189467992abdc3ce2c61cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:42Z,use_quota=True,user_id='105763aef51146f987fe39569be8f911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8761ef13-2428-4672-913e-1c5a687d46bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8761ef13-2428-4672-913e-1c5a687d46bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3be68f-7dbc-435a-b60d-3a570b59638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3be68f-7dbc-435a-b60d-3a570b59638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5873b619-d6dc-4c8b-ab9d-89eaf56669cc', 'volume_name': 'volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3397a29d-206f-4272-bf12-e66ed04a5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3397a29d-206f-4272-bf12-e66ed04a5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3b093e-b42e-416c-9e3f-8a471499652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:41 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Volume 5873b619-d6dc-4c8b-ab9d-89eaf56669cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc', 'volume_size': 1} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-581993086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5873b619-d6dc-4c8b-ab9d-89eaf56669cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4d042b0189467992abdc3ce2c61cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:42Z,use_quota=True,user_id='105763aef51146f987fe39569be8f911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Creating volume 5873b619-d6dc-4c8b-ab9d-89eaf56669cc {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:23:41 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:23:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:41 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc 1073741824 Nov 02 14:23:41 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:42 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc 1073741824" returned: 0 in 0.698s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:42 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc Nov 02 14:23:42 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:42 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc" returned: 0 in 0.480s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:23:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3b093e-b42e-416c-9e3f-8a471499652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ec5a5f-7474-469b-8916-c94c34b1c270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Volume volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc (5873b619-d6dc-4c8b-ab9d-89eaf56669cc): created successfully Nov 02 14:23:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ec5a5f-7474-469b-8916-c94c34b1c270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Flow 'volume_create_manager' (93b27dd1-4c2e-4a68-b998-ecd2412cf65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d806ca74-140b-492e-8559-5b593bb932c7 tempest-VolumeQuotasNegativeTestJSON-75713827 None] Created volume successfully. Nov 02 14:23:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-0ab3d1b9-3f54-4fb7-b626-977e0e55969b req-249f1ea4-02a2-4748-8779-2d06edfe830b tempest-ServerActionsTestOtherA-608641562 None] Terminate volume connection completed successfully. Nov 02 14:23:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-0ab3d1b9-3f54-4fb7-b626-977e0e55969b req-249f1ea4-02a2-4748-8779-2d06edfe830b tempest-ServerActionsTestOtherA-608641562 None] Deleting attachment b48056c1-e25c-4339-9ae9-6c449383a5ca. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:23:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-0ab3d1b9-3f54-4fb7-b626-977e0e55969b req-73e0b33a-7fab-459b-bc0c-6f9f5363c31f tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-0ab3d1b9-3f54-4fb7-b626-977e0e55969b req-73e0b33a-7fab-459b-bc0c-6f9f5363c31f tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-0ab3d1b9-3f54-4fb7-b626-977e0e55969b req-73e0b33a-7fab-459b-bc0c-6f9f5363c31f tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-0ab3d1b9-3f54-4fb7-b626-977e0e55969b req-73e0b33a-7fab-459b-bc0c-6f9f5363c31f tempest-ServerActionsTestOtherA-608641562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91ebe32b-5965-4728-84ae-b352d6625a7f', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:23:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-0ab3d1b9-3f54-4fb7-b626-977e0e55969b req-73e0b33a-7fab-459b-bc0c-6f9f5363c31f tempest-ServerActionsTestOtherA-608641562 None] attachment_update completed successfully. Nov 02 14:23:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Acquiring lock "cinder-5873b619-d6dc-4c8b-ab9d-89eaf56669cc-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:23:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "cinder-5873b619-d6dc-4c8b-ab9d-89eaf56669cc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:23:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Acquiring lock "cinder-quobyte-5873b619-d6dc-4c8b-ab9d-89eaf56669cc" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:23:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "cinder-quobyte-5873b619-d6dc-4c8b-ab9d-89eaf56669cc" acquired by "delete_volume" :: waited 0.039s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:23:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[14881d93-f5a7-4062-9774-0fbcecfecfdd]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:23:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:46 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc Nov 02 14:23:46 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:46 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc" returned: 0 in 0.437s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:46 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc Nov 02 14:23:46 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:47 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5873b619-d6dc-4c8b-ab9d-89eaf56669cc" returned: 0 in 0.465s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "cinder-quobyte-5873b619-d6dc-4c8b-ab9d-89eaf56669cc" released by "delete_volume" :: held 0.970s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Created reservations ['4a28fc8d-4c40-439a-9ff0-36bdafbbdc64', '895102cf-7a76-4ac4-b566-a3e95241b726', '8224a6c5-edc7-40af-b426-d2ef8319f811', 'a94149e6-92c5-4c23-86a5-bdd652357139'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:47 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:23:47 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:47 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.360s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:23:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Deleted volume successfully. Nov 02 14:23:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e31855a-ebee-4661-b26e-de370dc619ea tempest-VolumeQuotasNegativeTestJSON-75713827 None] Lock "cinder-5873b619-d6dc-4c8b-ab9d-89eaf56669cc-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=28,cinder:SELECT=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=31,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Flow 'volume_create_manager' (75dea204-4e6e-4200-afdf-f6f9a4238bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6e4164-b3d9-4b98-bf4e-35a90cbf0b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6e4164-b3d9-4b98-bf4e-35a90cbf0b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1297103352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b857f6-95a9-47d5-b69c-dae2fd35a88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f3f8895db94392977095b56ec4977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:58Z,use_quota=True,user_id='5cc0393f75be4699b7d4de23df2b56cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637c2df1-7225-4df3-91c5-8e6eb7353cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637c2df1-7225-4df3-91c5-8e6eb7353cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ce0a00-9e7a-46f1-8e93-0d5ca51254c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ce0a00-9e7a-46f1-8e93-0d5ca51254c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b857f6-95a9-47d5-b69c-dae2fd35a88e', 'volume_name': 'volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1215f9c-10d2-40db-bbf2-9f7626bcf049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1215f9c-10d2-40db-bbf2-9f7626bcf049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e394e2a-6bf0-405c-a743-a7b5eeb2eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:57 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Volume 38b857f6-95a9-47d5-b69c-dae2fd35a88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e', 'volume_size': 1} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1297103352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b857f6-95a9-47d5-b69c-dae2fd35a88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f3f8895db94392977095b56ec4977c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:23:58Z,use_quota=True,user_id='5cc0393f75be4699b7d4de23df2b56cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Creating volume 38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:23:57 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:23:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:57 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e 1073741824 Nov 02 14:23:57 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:58 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e 1073741824" returned: 0 in 0.844s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:23:58 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e Nov 02 14:23:58 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:23:59 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Nov 02 14:23:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e" returned: 0 in 0.338s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:23:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:23:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:23:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e394e2a-6bf0-405c-a743-a7b5eeb2eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff1484f-0d9a-4c44-bd8b-728b072806e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:23:59 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Volume volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e (38b857f6-95a9-47d5-b69c-dae2fd35a88e): created successfully Nov 02 14:23:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff1484f-0d9a-4c44-bd8b-728b072806e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:23:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Flow 'volume_create_manager' (75dea204-4e6e-4200-afdf-f6f9a4238bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:23:59 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3cf677eb-ae1d-40cb-87da-2878d199462d tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Created volume successfully. Nov 02 14:24:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Creating offline snapshot dd833e2d-6e37-466f-8dd4-28c8df86cd41 of volume 38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:24:00 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45bd1cd-069a-4dc6-9257-d5cd72d6c3d6]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:00 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e Nov 02 14:24:00 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:01 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e" returned: 0 in 0.597s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:01 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 1G Nov 02 14:24:01 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:01 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 1G" returned: 0 in 0.628s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:01 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 Nov 02 14:24:01 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:02 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41" returned: 0 in 0.601s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:02 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 is being set with open permissions: ugo+rw Nov 02 14:24:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:02 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 Nov 02 14:24:02 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-1a4a8195-7143-4a83-835e-b746b67f9943 req-167ba86f-c7ab-430a-93da-d0a4b33f50fe tempest-AttachVolumeNegativeTest-789012110 None] Terminate volume connection completed successfully. Nov 02 14:24:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-1a4a8195-7143-4a83-835e-b746b67f9943 req-167ba86f-c7ab-430a-93da-d0a4b33f50fe tempest-AttachVolumeNegativeTest-789012110 None] Deleting attachment 5552d460-3068-4aa7-97c4-51a4ac5808aa. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:24:02 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41" returned: 0 in 0.435s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:02 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.info Nov 02 14:24:02 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:03 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.info" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:03 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.info is being set with open permissions: ugo+rw Nov 02 14:24:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:03 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.info Nov 02 14:24:03 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:03 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.info" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.949s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e69bff08-43a3-4874-be8b-24011fdc6f06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Create snapshot completed successfully Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "cinder-dd833e2d-6e37-466f-8dd4-28c8df86cd41-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-dd833e2d-6e37-466f-8dd4-28c8df86cd41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "cinder-quobyte-38b857f6-95a9-47d5-b69c-dae2fd35a88e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-quobyte-38b857f6-95a9-47d5-b69c-dae2fd35a88e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "cinder-quobyte-dd833e2d-6e37-466f-8dd4-28c8df86cd41" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-quobyte-dd833e2d-6e37-466f-8dd4-28c8df86cd41" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Deleting offline snapshot dd833e2d-6e37-466f-8dd4-28c8df86cd41 of volume 38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] snapshot_file for this snap is: volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[233b036c-fe8a-4ac3-83bb-e277e935489a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:04 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 Nov 02 14:24:04 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:04 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:24:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ee9d1-bd5f-4c63-9f81-81db1c0ada32]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:05 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e Nov 02 14:24:05 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:05 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e" returned: 0 in 0.414s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:05 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 Nov 02 14:24:05 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:05 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41" returned: 0 in 0.421s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:05 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41 Nov 02 14:24:05 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:06 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e.dd833e2d-6e37-466f-8dd4-28c8df86cd41" returned: 0 in 0.310s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-quobyte-dd833e2d-6e37-466f-8dd4-28c8df86cd41" released by "_delete_snapshot" :: held 1.744s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-quobyte-38b857f6-95a9-47d5-b69c-dae2fd35a88e" released by "delete_snapshot" :: held 1.775s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:06 devstack cinder-volume[86978]: WARNING cinder.quota [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Created reservations ['22c3489c-8e86-43c6-bd81-555aaca6da37', '0e8dbae0-1cdd-4d88-a156-178bcda60e3a', '5421cad4-d183-47fe-a854-3a6eb25e432d', '24157254-0d4c-460f-b9af-10f05b126328'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:24:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Delete snapshot completed successfully. Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-66de5755-7758-4149-8a69-8fdeb40254f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-dd833e2d-6e37-466f-8dd4-28c8df86cd41-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "cinder-38b857f6-95a9-47d5-b69c-dae2fd35a88e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-38b857f6-95a9-47d5-b69c-dae2fd35a88e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "cinder-quobyte-38b857f6-95a9-47d5-b69c-dae2fd35a88e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-quobyte-38b857f6-95a9-47d5-b69c-dae2fd35a88e" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5134de67-08a0-4f68-a727-4050ec0cb0e0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:06 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e Nov 02 14:24:06 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:07 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e" returned: 0 in 0.392s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:07 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e Nov 02 14:24:07 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:07 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38b857f6-95a9-47d5-b69c-dae2fd35a88e" returned: 0 in 0.253s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-quobyte-38b857f6-95a9-47d5-b69c-dae2fd35a88e" released by "delete_volume" :: held 0.717s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Created reservations ['ecb142d6-b66a-4a80-95a2-0c54f1374837', 'a3abae30-44d4-4c92-8899-474c202dba10', '0aee58a6-4dbf-4839-8439-e681e26a2689', '78717d03-45b2-4f4d-91d6-48564ebf6700'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:07 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:24:07 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:08 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.303s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:08 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:24:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Deleted volume successfully. Nov 02 14:24:08 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-dc9d8b5c-3949-45f9-880a-13fa38a91569 tempest-VolumeSnapshotQuotasNegativeTestJSON-1375633255 None] Lock "cinder-38b857f6-95a9-47d5-b69c-dae2fd35a88e-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-a80d20bd-abcf-479f-9f9e-fcb4a683a51c req-aaae5bc2-0f31-406f-ae26-52528781cb54 tempest-ServerActionsTestOtherA-608641562 None] Terminate volume connection completed successfully. Nov 02 14:24:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-a80d20bd-abcf-479f-9f9e-fcb4a683a51c req-aaae5bc2-0f31-406f-ae26-52528781cb54 tempest-ServerActionsTestOtherA-608641562 None] Deleting attachment 91ebe32b-5965-4728-84ae-b352d6625a7f. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:24:23 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=17,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:24:23 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=19,cinder:UPDATE=20,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:24:24 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:24:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Flow 'volume_create_manager' (2a869350-a512-41df-ab11-39c4d616d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0834d26c-f0ef-4c48-a2d3-513466c704f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0834d26c-f0ef-4c48-a2d3-513466c704f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1115260442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad03c521a8dd411d9c7eda05b15c97f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:25Z,use_quota=True,user_id='040fa151bf2e46499a67b4f0c7dc9119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4e2f51-1216-4bb0-b669-14eef36e605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4e2f51-1216-4bb0-b669-14eef36e605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958005cb-22cf-4307-aa08-7fc21499dffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:25 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:24:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958005cb-22cf-4307-aa08-7fc21499dffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d', 'volume_name': 'volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cbce82-3873-45fb-a253-a7858809c667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cbce82-3873-45fb-a253-a7858809c667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2291d0e4-a696-47f2-87eb-845044b61f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:26 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Volume efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 14:24:26 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Trying to clone efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d from image 038a1496-6584-48e7-a7a3-32931ae28302 at location (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:24:27 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:24:27 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Image download 20.69 MB at 20.69 MB/s Nov 02 14:24:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c824a41-8431-49e6-a08c-12de917fd0dd]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:27 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD Nov 02 14:24:27 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:27 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD" returned: 0 in 0.535s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:27 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 is fetched for user 040fa151bf2e46499a67b4f0c7dc9119. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:24:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d5f6cc-70e4-4596-86ea-35843730fd86]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:28 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD Nov 02 14:24:28 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:28 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD" returned: 0 in 0.668s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1115260442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad03c521a8dd411d9c7eda05b15c97f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:25Z,use_quota=True,user_id='040fa151bf2e46499a67b4f0c7dc9119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Creating volume efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:24:28 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:24:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:28 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d 1073741824 Nov 02 14:24:28 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:29 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d 1073741824" returned: 0 in 0.975s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:29 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d Nov 02 14:24:29 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:29 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d" returned: 0 in 0.322s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:24:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:29 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Attempting download of 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2efa773-b9d0-48b2-92d1-cc401d200b88]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tkpxetwy {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:30 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tkpxetwy Nov 02 14:24:30 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:30 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tkpxetwy" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tkpxetwy {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:30 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tkpxetwy Nov 02 14:24:30 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:30 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tkpxetwy" returned: 1 in 0.376s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tkpxetwy' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[432fc056-201c-4f66-a007-4f25fd0f7582]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:30 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD Nov 02 14:24:30 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:31 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:31 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] 038a1496-6584-48e7-a7a3-32931ae28302 was qcow2, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:24:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:31 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d Nov 02 14:24:31 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:33 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d" returned: 0 in 2.145s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_7dbfceg3devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:24:33 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Converted 112.00 MB image at 52.18 MB/s Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:33 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d 1G Nov 02 14:24:33 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:33 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d 1G" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Downloaded image 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 for user 040fa151bf2e46499a67b4f0c7dc9119 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Marking volume efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Copying metadata from image 038a1496-6584-48e7-a7a3-32931ae28302 to efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Creating volume glance metadata for volume efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d backed by image 038a1496-6584-48e7-a7a3-32931ae28302 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2291d0e4-a696-47f2-87eb-845044b61f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93902290-ccd9-4eb2-817c-7d1eb5ea9c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:33 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Volume volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d (efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d): created successfully Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93902290-ccd9-4eb2-817c-7d1eb5ea9c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Flow 'volume_create_manager' (2a869350-a512-41df-ab11-39c4d616d904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:33 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e9c955b9-8aac-48c8-8557-9547bf001f83 tempest-ServerActionsTestOtherA-608641562 None] Created volume successfully. Nov 02 14:24:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-adcfd1cc-d1fa-4b65-b73c-711cf3bfe8da req-6638693c-93d2-43ca-a016-484f457e68ce tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-adcfd1cc-d1fa-4b65-b73c-711cf3bfe8da req-6638693c-93d2-43ca-a016-484f457e68ce tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-adcfd1cc-d1fa-4b65-b73c-711cf3bfe8da req-6638693c-93d2-43ca-a016-484f457e68ce tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-adcfd1cc-d1fa-4b65-b73c-711cf3bfe8da req-6638693c-93d2-43ca-a016-484f457e68ce tempest-ServerActionsTestOtherA-608641562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fae8c49-e529-471b-935c-c2756d2035b2', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:24:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-adcfd1cc-d1fa-4b65-b73c-711cf3bfe8da req-6638693c-93d2-43ca-a016-484f457e68ce tempest-ServerActionsTestOtherA-608641562 None] attachment_update completed successfully. Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:39 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:24:39 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:39 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.315s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:24:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Flow 'volume_create_manager' (0b14ec66-4f78-42bd-a3b0-7a7a73c71cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f187a4f-3548-4784-bf28-aa6cb25e9344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f187a4f-3548-4784-bf28-aa6cb25e9344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-573784617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe1b0f5-3bb9-426b-a983-509e9b6dda1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675551dbda4b4494be57aed2ece6fe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:41Z,use_quota=True,user_id='040fa1d18c60445f894a0a856e858c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f78061-afa5-4140-97ef-663dcc65404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f78061-afa5-4140-97ef-663dcc65404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8a7b64-1b54-440a-975b-2b7c3d2c2e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8a7b64-1b54-440a-975b-2b7c3d2c2e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe1b0f5-3bb9-426b-a983-509e9b6dda1c', 'volume_name': 'volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba1fb63-4376-42db-829c-80f65ed920df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba1fb63-4376-42db-829c-80f65ed920df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dfe7a6-36ba-478c-a45c-7956679f5c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:40 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Volume 0fe1b0f5-3bb9-426b-a983-509e9b6dda1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c', 'volume_size': 1} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-573784617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe1b0f5-3bb9-426b-a983-509e9b6dda1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675551dbda4b4494be57aed2ece6fe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:41Z,use_quota=True,user_id='040fa1d18c60445f894a0a856e858c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Creating volume 0fe1b0f5-3bb9-426b-a983-509e9b6dda1c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:24:40 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:24:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:40 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c 1073741824 Nov 02 14:24:40 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:41 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c 1073741824" returned: 0 in 0.893s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:42 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c Nov 02 14:24:42 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:42 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c" returned: 0 in 0.330s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:24:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dfe7a6-36ba-478c-a45c-7956679f5c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107b0739-cbea-4676-bd4c-c2069ed53ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Volume volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c (0fe1b0f5-3bb9-426b-a983-509e9b6dda1c): created successfully Nov 02 14:24:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107b0739-cbea-4676-bd4c-c2069ed53ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Flow 'volume_create_manager' (0b14ec66-4f78-42bd-a3b0-7a7a73c71cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-237e8391-5b7e-4884-8496-212522b11692 tempest-AttachVolumeTestJSON-987003269 None] Created volume successfully. Nov 02 14:24:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-cd97c62c-5d59-433b-8a5d-4d490f11791e req-f6f2fadc-4070-4c81-8d4c-c6d1156d6a40 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-cd97c62c-5d59-433b-8a5d-4d490f11791e req-f6f2fadc-4070-4c81-8d4c-c6d1156d6a40 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-cd97c62c-5d59-433b-8a5d-4d490f11791e req-f6f2fadc-4070-4c81-8d4c-c6d1156d6a40 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-cd97c62c-5d59-433b-8a5d-4d490f11791e req-f6f2fadc-4070-4c81-8d4c-c6d1156d6a40 tempest-AttachVolumeTestJSON-987003269 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3b25a60-bc2a-4056-a214-d3b90dd5faaf', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:24:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-cd97c62c-5d59-433b-8a5d-4d490f11791e req-f6f2fadc-4070-4c81-8d4c-c6d1156d6a40 tempest-AttachVolumeTestJSON-987003269 None] attachment_update completed successfully. Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Flow 'volume_create_manager' (0c94e829-8cf3-4591-9654-26a65930e2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb9144b-303e-4408-aa84-8930688fdbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb9144b-303e-4408-aa84-8930688fdbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-151439048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab43bcba-683e-437d-a1a8-0a4ea271764f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db68683f9794606964119ec2c5e7b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:44Z,use_quota=True,user_id='2a754ac9938d45d988a73206dd3de60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b408a41-61bc-41ac-b32f-b7367edb4fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b408a41-61bc-41ac-b32f-b7367edb4fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f5540d-a92c-418c-b60b-a1acec8c9344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f5540d-a92c-418c-b60b-a1acec8c9344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab43bcba-683e-437d-a1a8-0a4ea271764f', 'volume_name': 'volume-ab43bcba-683e-437d-a1a8-0a4ea271764f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9328db-7445-4e64-8fcb-1c3ca6f3039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9328db-7445-4e64-8fcb-1c3ca6f3039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc957748-c7f4-4d74-a41c-0b9306d93c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Volume ab43bcba-683e-437d-a1a8-0a4ea271764f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab43bcba-683e-437d-a1a8-0a4ea271764f', 'volume_size': 1} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-151439048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab43bcba-683e-437d-a1a8-0a4ea271764f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db68683f9794606964119ec2c5e7b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:44Z,use_quota=True,user_id='2a754ac9938d45d988a73206dd3de60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Creating volume ab43bcba-683e-437d-a1a8-0a4ea271764f {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:24:44 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:24:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:44 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f 1073741824 Nov 02 14:24:44 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:45 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f 1073741824" returned: 0 in 0.688s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:45 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f Nov 02 14:24:45 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:45 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f" returned: 0 in 0.366s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc957748-c7f4-4d74-a41c-0b9306d93c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab43bcba-683e-437d-a1a8-0a4ea271764f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c0d903-71dd-4ee3-baee-cbe9fa68d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Volume volume-ab43bcba-683e-437d-a1a8-0a4ea271764f (ab43bcba-683e-437d-a1a8-0a4ea271764f): created successfully Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c0d903-71dd-4ee3-baee-cbe9fa68d621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Flow 'volume_create_manager' (0c94e829-8cf3-4591-9654-26a65930e2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ec8a4e2c-a5c1-48b3-8d03-8fcafd393f1d tempest-VolumesTransfersTest-2003261921 None] Created volume successfully. Nov 02 14:24:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c8aed9cd-cd42-496a-9235-0d38e2432c96 tempest-VolumesTransfersTest-813575671 None] Transfer volume completed successfully. Nov 02 14:24:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Acquiring lock "cinder-ab43bcba-683e-437d-a1a8-0a4ea271764f-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-ab43bcba-683e-437d-a1a8-0a4ea271764f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Acquiring lock "cinder-quobyte-ab43bcba-683e-437d-a1a8-0a4ea271764f" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-quobyte-ab43bcba-683e-437d-a1a8-0a4ea271764f" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381ec9d-ea55-40a2-b373-13a570218385]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:49 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f Nov 02 14:24:49 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:50 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f" returned: 0 in 0.848s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:50 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f Nov 02 14:24:50 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:50 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ab43bcba-683e-437d-a1a8-0a4ea271764f" returned: 0 in 0.512s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-quobyte-ab43bcba-683e-437d-a1a8-0a4ea271764f" released by "delete_volume" :: held 1.475s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:50 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Created reservations ['7bba0ded-053a-418a-9ca5-a1bcabacd3bc', '6e2d2834-c720-4554-9a10-3bf34f1005e4', 'b50762a9-f3b0-4dcf-9388-f1387fcfe803', 'de7e120e-f32c-4a42-9b43-19ca8985c650'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:51 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:24:51 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:51 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.336s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:24:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Deleted volume successfully. Nov 02 14:24:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-87868542-7ed8-48cd-b088-9785f43e4c53 tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-ab43bcba-683e-437d-a1a8-0a4ea271764f-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Flow 'volume_create_manager' (c48c0989-4bef-43ac-a944-8f49b4bd1371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c148be-c8e0-4c9c-8d29-c1ad9edc3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c148be-c8e0-4c9c-8d29-c1ad9edc3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1192523814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3756bf-5e85-48aa-a5c6-bb1729a40af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac97d315bf5941419ca62a07286c6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:53Z,use_quota=True,user_id='b3b0191c5e0f4577a6015274b493a5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e786f8-ab86-4e11-87c0-44b9fd0ccfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e786f8-ab86-4e11-87c0-44b9fd0ccfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c547509-7641-4861-9870-246440f74c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c547509-7641-4861-9870-246440f74c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af3756bf-5e85-48aa-a5c6-bb1729a40af2', 'volume_name': 'volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd2e733-58bb-4fbf-8de0-ba8ad08e460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd2e733-58bb-4fbf-8de0-ba8ad08e460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eccd5ac-04c3-4517-b39a-a51e602ac025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:52 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Volume af3756bf-5e85-48aa-a5c6-bb1729a40af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2', 'volume_size': 1} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1192523814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3756bf-5e85-48aa-a5c6-bb1729a40af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac97d315bf5941419ca62a07286c6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:53Z,use_quota=True,user_id='b3b0191c5e0f4577a6015274b493a5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Creating volume af3756bf-5e85-48aa-a5c6-bb1729a40af2 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:24:52 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:24:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:52 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 1073741824 Nov 02 14:24:52 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Flow 'volume_create_manager' (fbb9180f-5659-4687-a5c8-a0f5258119fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a22a25-0f41-409f-a839-070a06955a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a22a25-0f41-409f-a839-070a06955a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1700932925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdea974-022e-41b1-8607-4b6e0715bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db68683f9794606964119ec2c5e7b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:53Z,use_quota=True,user_id='2a754ac9938d45d988a73206dd3de60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63351f7a-34cf-459f-b353-e43f0f87d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63351f7a-34cf-459f-b353-e43f0f87d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3f01ba-6a31-4320-9075-db6d86c36a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3f01ba-6a31-4320-9075-db6d86c36a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdea974-022e-41b1-8607-4b6e0715bf4b', 'volume_name': 'volume-ffdea974-022e-41b1-8607-4b6e0715bf4b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdb6d9c-34a4-4ba3-ac83-d13da383e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdb6d9c-34a4-4ba3-ac83-d13da383e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0799109c-53ef-49a4-bd48-c3926d215f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:53 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Volume ffdea974-022e-41b1-8607-4b6e0715bf4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdea974-022e-41b1-8607-4b6e0715bf4b', 'volume_size': 1} Nov 02 14:24:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:54 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 1073741824" returned: 0 in 1.234s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:54 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 Nov 02 14:24:54 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:54 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2" returned: 0 in 0.698s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1700932925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdea974-022e-41b1-8607-4b6e0715bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db68683f9794606964119ec2c5e7b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:24:53Z,use_quota=True,user_id='2a754ac9938d45d988a73206dd3de60d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Creating volume ffdea974-022e-41b1-8607-4b6e0715bf4b {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:24:54 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:54 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b 1073741824 Nov 02 14:24:54 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eccd5ac-04c3-4517-b39a-a51e602ac025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4005430b-85d7-43b1-b522-7d396774eb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:55 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Volume volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 (af3756bf-5e85-48aa-a5c6-bb1729a40af2): created successfully Nov 02 14:24:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4005430b-85d7-43b1-b522-7d396774eb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Flow 'volume_create_manager' (c48c0989-4bef-43ac-a944-8f49b4bd1371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6c163228-0f82-4d44-ac09-d57cc3336465 tempest-AttachVolumeNegativeTest-789012110 None] Created volume successfully. Nov 02 14:24:55 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b 1073741824" returned: 0 in 1.087s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:56 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b Nov 02 14:24:56 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:56 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b" returned: 0 in 0.619s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0799109c-53ef-49a4-bd48-c3926d215f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdea974-022e-41b1-8607-4b6e0715bf4b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698363b6-c8b5-47d4-95ee-2f43d0e0173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:24:56 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Volume volume-ffdea974-022e-41b1-8607-4b6e0715bf4b (ffdea974-022e-41b1-8607-4b6e0715bf4b): created successfully Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698363b6-c8b5-47d4-95ee-2f43d0e0173e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:24:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Flow 'volume_create_manager' (fbb9180f-5659-4687-a5c8-a0f5258119fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:24:56 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-128ec8de-4a32-4574-8722-48ed803041c8 tempest-VolumesTransfersTest-2003261921 None] Created volume successfully. Nov 02 14:24:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-ecc15caf-df0e-40d4-abc3-4f2f10ae5c09 req-8e605d2e-ac79-4493-9a65-efc2a1cfa6f6 tempest-ServerActionsTestOtherA-608641562 None] Terminate volume connection completed successfully. Nov 02 14:24:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-ecc15caf-df0e-40d4-abc3-4f2f10ae5c09 req-8e605d2e-ac79-4493-9a65-efc2a1cfa6f6 tempest-ServerActionsTestOtherA-608641562 None] Deleting attachment 7fae8c49-e529-471b-935c-c2756d2035b2. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:24:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Acquiring lock "cinder-ffdea974-022e-41b1-8607-4b6e0715bf4b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-ffdea974-022e-41b1-8607-4b6e0715bf4b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c00b11b0-ca38-4d06-b76c-1241927897a2 req-4ffcd113-7325-42cc-b40f-c4487bd2cb83 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c00b11b0-ca38-4d06-b76c-1241927897a2 req-4ffcd113-7325-42cc-b40f-c4487bd2cb83 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c00b11b0-ca38-4d06-b76c-1241927897a2 req-4ffcd113-7325-42cc-b40f-c4487bd2cb83 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Acquiring lock "cinder-quobyte-ffdea974-022e-41b1-8607-4b6e0715bf4b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-quobyte-ffdea974-022e-41b1-8607-4b6e0715bf4b" acquired by "delete_volume" :: waited 0.039s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-c00b11b0-ca38-4d06-b76c-1241927897a2 req-4ffcd113-7325-42cc-b40f-c4487bd2cb83 tempest-AttachVolumeNegativeTest-789012110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2aed1320-6f6c-45dc-8b4b-4541373c1fe4', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a19bed4-1f0c-41f3-94d1-8f0f5513c6fd]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-c00b11b0-ca38-4d06-b76c-1241927897a2 req-4ffcd113-7325-42cc-b40f-c4487bd2cb83 tempest-AttachVolumeNegativeTest-789012110 None] attachment_update completed successfully. Nov 02 14:24:58 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b Nov 02 14:24:58 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:58 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b" returned: 0 in 0.666s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:58 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b Nov 02 14:24:58 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:59 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ffdea974-022e-41b1-8607-4b6e0715bf4b" returned: 0 in 0.480s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-quobyte-ffdea974-022e-41b1-8607-4b6e0715bf4b" released by "delete_volume" :: held 1.213s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Created reservations ['6c2acb1b-6151-4bb2-8937-b1ea5c19bfde', '953fbe4d-432c-42b1-a76f-24c0e3801f92', '9807d417-169a-43e6-9366-fe5dc1cf5a42', '67cb4fcd-21f5-49ae-9915-d4bbfd07efb0'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:24:59 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:24:59 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:24:59 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:24:59 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Deleted volume successfully. Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f18dfa97-a198-4e7b-95a7-048513ed7c8c tempest-VolumesTransfersTest-2138742503 None] Lock "cinder-ffdea974-022e-41b1-8607-4b6e0715bf4b-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-ecc15caf-df0e-40d4-abc3-4f2f10ae5c09 req-1909b3e8-16d6-4810-9e69-dab2fe2772a2 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-ecc15caf-df0e-40d4-abc3-4f2f10ae5c09 req-1909b3e8-16d6-4810-9e69-dab2fe2772a2 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-ecc15caf-df0e-40d4-abc3-4f2f10ae5c09 req-1909b3e8-16d6-4810-9e69-dab2fe2772a2 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:24:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-ecc15caf-df0e-40d4-abc3-4f2f10ae5c09 req-1909b3e8-16d6-4810-9e69-dab2fe2772a2 tempest-ServerActionsTestOtherA-608641562 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be6b75bc-f0ae-4587-8cdb-14aceef5d161', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:24:59 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-ecc15caf-df0e-40d4-abc3-4f2f10ae5c09 req-1909b3e8-16d6-4810-9e69-dab2fe2772a2 tempest-ServerActionsTestOtherA-608641562 None] attachment_update completed successfully. Nov 02 14:25:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-25a73f5c-0158-4a8d-8c75-45cefaaa910a req-6b331573-9060-4afb-9024-28dc5bb35572 tempest-AttachVolumeNegativeTest-789012110 None] Terminate volume connection completed successfully. Nov 02 14:25:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-25a73f5c-0158-4a8d-8c75-45cefaaa910a req-6b331573-9060-4afb-9024-28dc5bb35572 tempest-AttachVolumeNegativeTest-789012110 None] Deleting attachment 2aed1320-6f6c-45dc-8b4b-4541373c1fe4. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:25:10 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=55,cinder:INSERT=15,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:25:10 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=40,cinder:SELECT=57,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Flow 'volume_create_manager' (71dcdca7-0034-4877-b6c3-8e85b44f397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9e4cc3-31ba-4f03-b613-2d3c97be45b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9e4cc3-31ba-4f03-b613-2d3c97be45b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1313665803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd035af-e35f-44c0-82ff-50f70510645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41568fa32094af1ac2b53e58695535c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:15Z,use_quota=True,user_id='a8e339b5d5994e3d9cd7402bab257346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a856833-b3a6-4ce8-bdbf-9055573c47b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a856833-b3a6-4ce8-bdbf-9055573c47b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63cfa1c-13d7-481d-9cc4-7b666a9e2901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63cfa1c-13d7-481d-9cc4-7b666a9e2901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd035af-e35f-44c0-82ff-50f70510645e', 'volume_name': 'volume-1cd035af-e35f-44c0-82ff-50f70510645e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3394b0-bf1a-4820-bdb6-2a71a04b6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3394b0-bf1a-4820-bdb6-2a71a04b6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124161a9-5469-4a5c-af3a-c3526baaa02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:14 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Volume 1cd035af-e35f-44c0-82ff-50f70510645e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd035af-e35f-44c0-82ff-50f70510645e', 'volume_size': 1} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1313665803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd035af-e35f-44c0-82ff-50f70510645e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41568fa32094af1ac2b53e58695535c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:15Z,use_quota=True,user_id='a8e339b5d5994e3d9cd7402bab257346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Creating volume 1cd035af-e35f-44c0-82ff-50f70510645e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:25:14 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:25:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:14 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e 1073741824 Nov 02 14:25:14 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:15 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e 1073741824" returned: 0 in 0.588s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:15 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e Nov 02 14:25:15 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:15 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e" returned: 0 in 0.396s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:25:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124161a9-5469-4a5c-af3a-c3526baaa02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd035af-e35f-44c0-82ff-50f70510645e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c325ef4-abeb-434d-adcb-9b7c5f2c2fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:16 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Volume volume-1cd035af-e35f-44c0-82ff-50f70510645e (1cd035af-e35f-44c0-82ff-50f70510645e): created successfully Nov 02 14:25:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c325ef4-abeb-434d-adcb-9b7c5f2c2fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Flow 'volume_create_manager' (71dcdca7-0034-4877-b6c3-8e85b44f397d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b4519a0c-cc57-43c8-a7a0-7249e9cd6fd3 tempest-VolumesTransfersV357Test-1385812414 None] Created volume successfully. Nov 02 14:25:17 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-eb63bde8-7471-44a9-8f7e-410c2ac139f3 tempest-VolumesTransfersV357Test-1271610995 None] Transfer volume completed successfully. Nov 02 14:25:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Acquiring lock "cinder-1cd035af-e35f-44c0-82ff-50f70510645e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-1cd035af-e35f-44c0-82ff-50f70510645e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Acquiring lock "cinder-quobyte-1cd035af-e35f-44c0-82ff-50f70510645e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-quobyte-1cd035af-e35f-44c0-82ff-50f70510645e" acquired by "delete_volume" :: waited 0.038s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb23b259-1565-4000-9b60-34ae0aec51b8]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:25:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:19 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e Nov 02 14:25:19 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:20 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e" returned: 0 in 1.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:20 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e Nov 02 14:25:20 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:20 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1cd035af-e35f-44c0-82ff-50f70510645e" returned: 0 in 0.408s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-quobyte-1cd035af-e35f-44c0-82ff-50f70510645e" released by "delete_volume" :: held 1.816s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Created reservations ['eb474fc7-be2e-408d-87b6-ee3513c5f72f', '40619afa-5412-4d9a-bda9-8096afa69990', 'c356a119-7739-48d2-aa65-d335351335a0', '00afac81-b514-4627-8774-6739136bf0ee'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:21 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:25:21 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:21 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.435s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:25:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Deleted volume successfully. Nov 02 14:25:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3f74dc8b-8a86-41e1-839f-f0862cde0cbd tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-1cd035af-e35f-44c0-82ff-50f70510645e-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Flow 'volume_create_manager' (4b480ef9-4e28-47be-bd62-405c5213f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce87cd2-1c3e-4a36-863f-a5143af7d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce87cd2-1c3e-4a36-863f-a5143af7d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1935906212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8d3f4c-7c4d-4aa5-9411-20658fb47183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41568fa32094af1ac2b53e58695535c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:22Z,use_quota=True,user_id='a8e339b5d5994e3d9cd7402bab257346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13aed2e0-7100-425a-becf-4be2bd0bd983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13aed2e0-7100-425a-becf-4be2bd0bd983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741784e4-f806-4f59-b49b-5ecb6c48f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741784e4-f806-4f59-b49b-5ecb6c48f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8d3f4c-7c4d-4aa5-9411-20658fb47183', 'volume_name': 'volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075d147e-6534-443b-b9b7-ad2c3b37e540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075d147e-6534-443b-b9b7-ad2c3b37e540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12baeee0-6a32-4ea7-8980-4592acb75c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Volume 0d8d3f4c-7c4d-4aa5-9411-20658fb47183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183', 'volume_size': 1} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1935906212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8d3f4c-7c4d-4aa5-9411-20658fb47183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41568fa32094af1ac2b53e58695535c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:22Z,use_quota=True,user_id='a8e339b5d5994e3d9cd7402bab257346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Creating volume 0d8d3f4c-7c4d-4aa5-9411-20658fb47183 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:25:22 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:25:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:22 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 1073741824 Nov 02 14:25:22 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:23 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 1073741824" returned: 0 in 0.578s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:23 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 Nov 02 14:25:23 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:23 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12baeee0-6a32-4ea7-8980-4592acb75c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ff0e6e-e04b-4d41-a7b2-dbaf2a373dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Volume volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 (0d8d3f4c-7c4d-4aa5-9411-20658fb47183): created successfully Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ff0e6e-e04b-4d41-a7b2-dbaf2a373dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Flow 'volume_create_manager' (4b480ef9-4e28-47be-bd62-405c5213f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-97bd54ed-bf99-40de-9819-4156dd0a54be tempest-VolumesTransfersV357Test-1385812414 None] Created volume successfully. Nov 02 14:25:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Acquiring lock "cinder-0d8d3f4c-7c4d-4aa5-9411-20658fb47183-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-0d8d3f4c-7c4d-4aa5-9411-20658fb47183-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Acquiring lock "cinder-quobyte-0d8d3f4c-7c4d-4aa5-9411-20658fb47183" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-quobyte-0d8d3f4c-7c4d-4aa5-9411-20658fb47183" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae321b2-7bab-4c1c-bdb7-d6fb2d387e25]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:25 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 Nov 02 14:25:25 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:25 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183" returned: 0 in 0.420s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:25 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183 Nov 02 14:25:25 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:25 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0d8d3f4c-7c4d-4aa5-9411-20658fb47183" returned: 0 in 0.280s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-quobyte-0d8d3f4c-7c4d-4aa5-9411-20658fb47183" released by "delete_volume" :: held 0.773s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Created reservations ['9a041e99-208e-428a-85d2-dee59a731b39', 'be5e1982-b941-4635-8000-6d49e8826512', 'a339f9fa-3a94-4711-88e6-5f13c7bfd1c4', '99865d8d-9626-42f5-9113-4c2a28fabbd0'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:25 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:25:25 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:26 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:26 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:25:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Deleted volume successfully. Nov 02 14:25:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0d7d6804-452f-46c3-992e-32345b591f39 tempest-VolumesTransfersV357Test-28147277 None] Lock "cinder-0d8d3f4c-7c4d-4aa5-9411-20658fb47183-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-6c6c2264-1ff0-4182-af17-58c686331b85 req-a32b6dfe-a5ea-476a-81f3-cd9058fb8b7d tempest-AttachVolumeTestJSON-987003269 None] Terminate volume connection completed successfully. Nov 02 14:25:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-6c6c2264-1ff0-4182-af17-58c686331b85 req-a32b6dfe-a5ea-476a-81f3-cd9058fb8b7d tempest-AttachVolumeTestJSON-987003269 None] Deleting attachment b3b25a60-bc2a-4056-a214-d3b90dd5faaf. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:25:36 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=20,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:39 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:25:39 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:39 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.332s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:25:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Flow 'volume_create_manager' (d5358a2d-ece6-4803-8700-9354a3da1878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025ebca2-7ab9-4896-ab0a-ea0bc416f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025ebca2-7ab9-4896-ab0a-ea0bc416f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1241885607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371b5a21-dba7-46e9-b686-39fc53541642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730fc913edba4e859aa1d73798552bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:43Z,use_quota=True,user_id='a0bbc4b939464e7491a087aff300754c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f689a4-c454-4a76-b29b-3cf7ce48acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f689a4-c454-4a76-b29b-3cf7ce48acaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85642ffa-c655-4e95-b3d3-d1f65bcb6049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85642ffa-c655-4e95-b3d3-d1f65bcb6049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371b5a21-dba7-46e9-b686-39fc53541642', 'volume_name': 'volume-371b5a21-dba7-46e9-b686-39fc53541642', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1a371f-a2a5-4e07-8c59-667a1cc0d99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1a371f-a2a5-4e07-8c59-667a1cc0d99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaed955-229f-4645-92eb-a65d1753be04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Volume 371b5a21-dba7-46e9-b686-39fc53541642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371b5a21-dba7-46e9-b686-39fc53541642', 'volume_size': 1} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1241885607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371b5a21-dba7-46e9-b686-39fc53541642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730fc913edba4e859aa1d73798552bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:43Z,use_quota=True,user_id='a0bbc4b939464e7491a087aff300754c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Creating volume 371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:25:43 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:25:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:43 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 1073741824 Nov 02 14:25:43 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:44 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 1073741824" returned: 0 in 0.465s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:44 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:25:44 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:44 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eaed955-229f-4645-92eb-a65d1753be04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371b5a21-dba7-46e9-b686-39fc53541642', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117bf015-1803-4194-b977-8799ef947379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Volume volume-371b5a21-dba7-46e9-b686-39fc53541642 (371b5a21-dba7-46e9-b686-39fc53541642): created successfully Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117bf015-1803-4194-b977-8799ef947379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Flow 'volume_create_manager' (d5358a2d-ece6-4803-8700-9354a3da1878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1c19d369-8fe6-425a-a874-44745fbe452e tempest-VolumesActionsTest-725112783 None] Created volume successfully. Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Flow 'volume_create_manager' (174951aa-36e4-466d-a198-33ffa684c047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718f2203-8684-4eb7-87ac-20cff761eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718f2203-8684-4eb7-87ac-20cff761eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1210004092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dda1ab4-30d1-4641-b8b9-496bb365a1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac97d315bf5941419ca62a07286c6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:45Z,use_quota=True,user_id='b3b0191c5e0f4577a6015274b493a5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfffdf8-cf95-4622-8656-281f9663f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dfffdf8-cf95-4622-8656-281f9663f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7802f85d-7475-4308-b454-9283ffa97d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7802f85d-7475-4308-b454-9283ffa97d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dda1ab4-30d1-4641-b8b9-496bb365a1fd', 'volume_name': 'volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2fc02b-9557-475a-860d-0662a64764e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2fc02b-9557-475a-860d-0662a64764e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a894fa-8324-411f-bdf5-769aec94066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Volume 4dda1ab4-30d1-4641-b8b9-496bb365a1fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd', 'volume_size': 1} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1210004092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dda1ab4-30d1-4641-b8b9-496bb365a1fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac97d315bf5941419ca62a07286c6207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:25:45Z,use_quota=True,user_id='b3b0191c5e0f4577a6015274b493a5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Creating volume 4dda1ab4-30d1-4641-b8b9-496bb365a1fd {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:25:45 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:25:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:45 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd 1073741824 Nov 02 14:25:45 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:46 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd 1073741824" returned: 0 in 0.478s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:46 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd Nov 02 14:25:46 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:46 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd" returned: 0 in 0.317s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a894fa-8324-411f-bdf5-769aec94066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7054f8d6-f984-4131-adb9-9b2c36e2bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:25:46 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Volume volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd (4dda1ab4-30d1-4641-b8b9-496bb365a1fd): created successfully Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7054f8d6-f984-4131-adb9-9b2c36e2bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:25:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Flow 'volume_create_manager' (174951aa-36e4-466d-a198-33ffa684c047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:25:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-aa7289d9-250f-49bc-95be-2375cc9f5b19 tempest-AttachVolumeNegativeTest-789012110 None] Created volume successfully. Nov 02 14:25:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-52df1be2-78e5-46f9-9b29-cdd9659e2617 req-6d9b4f40-73d6-448a-9399-14009b971318 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-52df1be2-78e5-46f9-9b29-cdd9659e2617 req-6d9b4f40-73d6-448a-9399-14009b971318 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-52df1be2-78e5-46f9-9b29-cdd9659e2617 req-6d9b4f40-73d6-448a-9399-14009b971318 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-52df1be2-78e5-46f9-9b29-cdd9659e2617 req-6d9b4f40-73d6-448a-9399-14009b971318 tempest-AttachVolumeNegativeTest-789012110 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed852048-dbf4-449f-9db0-432c527894d7', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:25:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-52df1be2-78e5-46f9-9b29-cdd9659e2617 req-6d9b4f40-73d6-448a-9399-14009b971318 tempest-AttachVolumeNegativeTest-789012110 None] attachment_update completed successfully. Nov 02 14:25:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-dd67296e-38af-4bc1-b5fb-30e07c34460e tempest-ServerActionsTestOtherA-608641562 None] Terminate volume connection completed successfully. Nov 02 14:25:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-dd67296e-38af-4bc1-b5fb-30e07c34460e tempest-ServerActionsTestOtherA-608641562 None] Deleting attachment be6b75bc-f0ae-4587-8cdb-14aceef5d161. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:25:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "cinder-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "cinder-quobyte-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-quobyte-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[628f3327-8239-491b-8bdb-fffc0ad0e522]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:25:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:52 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d Nov 02 14:25:52 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:52 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d" returned: 0 in 0.706s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:52 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d Nov 02 14:25:52 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-fc096e5c-8c98-4b58-b77c-5767286c179a req-46bb425e-a20e-4a07-a7d6-f036bc36ad17 tempest-AttachVolumeNegativeTest-789012110 None] Terminate volume connection completed successfully. Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-fc096e5c-8c98-4b58-b77c-5767286c179a req-46bb425e-a20e-4a07-a7d6-f036bc36ad17 tempest-AttachVolumeNegativeTest-789012110 None] Deleting attachment ed852048-dbf4-449f-9db0-432c527894d7. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:25:53 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d" returned: 0 in 0.457s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-quobyte-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d" released by "delete_volume" :: held 1.240s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG cinder.quota [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Created reservations ['3ec12fb9-7278-4dc6-b2d0-8896463a1185', '2c2ad1d5-a9cb-46c4-b736-546a8cec348a', 'ecf68d84-ad7d-427c-8da1-49603310d7a1', 'c0e1a8ed-4d7f-4e85-9001-282b1a40294d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:53 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:25:53 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "cinder-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "cinder-quobyte-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-quobyte-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:25:54 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.656s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG cinder.manager [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea314e7c-6f58-40df-830c-f7444f5a04df]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Deleted volume successfully. Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-d8ae67b7-44fd-46ea-9f00-51fad90d51a0 req-a0004fd1-3d4d-4bff-b849-56768d700ede tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-efe10cb1-2b88-4d4c-9363-f3e3d4cdb57d-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:54 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 Nov 02 14:25:54 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:54 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3" returned: 0 in 0.725s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:54 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3 Nov 02 14:25:54 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:55 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-quobyte-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3" released by "delete_volume" :: held 1.186s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Created reservations ['0ccb75a8-88e2-4b46-97af-403691d001f6', '2f70d801-6ee9-466a-858a-45b8ca8a04bc', 'd8691b11-5cb1-49cb-a903-44724d8d8efa', 'cd37cc60-f2ec-4aeb-b756-4a613f0212a9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:25:55 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:25:55 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:25:55 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.291s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:25:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Deleted volume successfully. Nov 02 14:25:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3780a0f-f2ef-493e-baf4-899360b2f007 tempest-ServerActionsTestOtherA-608641562 None] Lock "cinder-c32bf36b-639b-46b4-a7e6-57fd7e3bf4d3-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:25:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f4791104-6da9-4c79-96b2-7f309b428206 tempest-VolumesActionsTest-725112783 None] Acquiring lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642" by "attach_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:25:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f4791104-6da9-4c79-96b2-7f309b428206 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642" acquired by "attach_volume" :: waited 0.047s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f4791104-6da9-4c79-96b2-7f309b428206 tempest-VolumesActionsTest-725112783 None] Attaching volume 371b5a21-dba7-46e9-b686-39fc53541642 to instance de716bba-45b4-42e8-a182-f7d375da4a84 at mountpoint /dev/vdb on host None. Nov 02 14:26:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f4791104-6da9-4c79-96b2-7f309b428206 tempest-VolumesActionsTest-725112783 None] Attach volume completed successfully. Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f4791104-6da9-4c79-96b2-7f309b428206 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642" released by "attach_volume" :: held 0.164s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-841d87f7-ceb9-413e-9f30-0a23d3819650 tempest-VolumesActionsTest-725112783 None] Acquiring lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-detach_volume" by "detach_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-841d87f7-ceb9-413e-9f30-0a23d3819650 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-841d87f7-ceb9-413e-9f30-0a23d3819650 tempest-VolumesActionsTest-725112783 None] Detaching volume 371b5a21-dba7-46e9-b686-39fc53541642 from instance de716bba-45b4-42e8-a182-f7d375da4a84. Nov 02 14:26:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-841d87f7-ceb9-413e-9f30-0a23d3819650 tempest-VolumesActionsTest-725112783 None] Detach volume completed successfully. Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-841d87f7-ceb9-413e-9f30-0a23d3819650 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "cinder-4dda1ab4-30d1-4641-b8b9-496bb365a1fd-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-4dda1ab4-30d1-4641-b8b9-496bb365a1fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "cinder-quobyte-4dda1ab4-30d1-4641-b8b9-496bb365a1fd" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-quobyte-4dda1ab4-30d1-4641-b8b9-496bb365a1fd" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b5207-17be-4174-a799-28e0c01df61f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:26:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:01 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd Nov 02 14:26:01 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:01 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd" returned: 0 in 0.586s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:01 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd Nov 02 14:26:01 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:01 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4dda1ab4-30d1-4641-b8b9-496bb365a1fd" returned: 0 in 0.268s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-quobyte-4dda1ab4-30d1-4641-b8b9-496bb365a1fd" released by "delete_volume" :: held 0.914s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Created reservations ['d0444ac5-bd2a-468e-9d54-57176a815114', '9663b013-3501-4198-96c3-c339822fb441', 'e0dee899-f745-4885-bd7d-c58f0eb205ce', '639b4e66-8197-4e8e-8734-a39f3887df70'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:26:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:01 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:26:01 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:02 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:02 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:26:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Deleted volume successfully. Nov 02 14:26:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e4984b28-44fa-432b-87e0-d1c4fc4fac6b tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-4dda1ab4-30d1-4641-b8b9-496bb365a1fd-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "cinder-af3756bf-5e85-48aa-a5c6-bb1729a40af2-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-af3756bf-5e85-48aa-a5c6-bb1729a40af2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "cinder-quobyte-af3756bf-5e85-48aa-a5c6-bb1729a40af2" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-quobyte-af3756bf-5e85-48aa-a5c6-bb1729a40af2" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[689f548e-d1ea-4693-b4ee-886599ed3ea2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:03 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 Nov 02 14:26:03 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:03 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2" returned: 0 in 0.437s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:03 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2 Nov 02 14:26:03 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:04 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-af3756bf-5e85-48aa-a5c6-bb1729a40af2" returned: 0 in 0.327s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-quobyte-af3756bf-5e85-48aa-a5c6-bb1729a40af2" released by "delete_volume" :: held 0.844s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Created reservations ['dbabd9bb-6c67-4a47-b911-02b1ed15b3ce', '279b787f-845c-462e-bf9e-237b63a98523', 'c0e29ac4-dc74-43a4-a6ee-441c87e9381a', '46f794f3-6fcc-4d98-9de9-32acbb810e88'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:04 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:26:04 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "cinder-74c1ed9c-df7b-48cc-b92e-b56db48ab73b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-74c1ed9c-df7b-48cc-b92e-b56db48ab73b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "cinder-quobyte-74c1ed9c-df7b-48cc-b92e-b56db48ab73b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:04 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.345s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-quobyte-74c1ed9c-df7b-48cc-b92e-b56db48ab73b" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Deleted volume successfully. Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad000a27-544a-41f4-a8f5-96cfe43ad1c3]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-222495b1-3088-4d71-99a3-386f35aee6ff tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-af3756bf-5e85-48aa-a5c6-bb1729a40af2-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:04 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b Nov 02 14:26:04 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:05 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b" returned: 0 in 0.472s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:05 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b Nov 02 14:26:05 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:05 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74c1ed9c-df7b-48cc-b92e-b56db48ab73b" returned: 0 in 0.286s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-quobyte-74c1ed9c-df7b-48cc-b92e-b56db48ab73b" released by "delete_volume" :: held 0.823s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Created reservations ['bf16a326-184c-4588-9fa8-c0fe6c6e45ea', '56efaa22-5651-4173-af91-6bee6256ecc1', '589d05ef-bdc6-469f-9adb-f29ae089bea6', '2f8d5b0a-0bdb-4035-9504-598688d5a290'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:05 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:26:05 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:05 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.311s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:05 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:26:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Deleted volume successfully. Nov 02 14:26:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8c344de7-06de-4384-8938-f6e9b666c147 tempest-AttachVolumeNegativeTest-789012110 None] Lock "cinder-74c1ed9c-df7b-48cc-b92e-b56db48ab73b-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4464f12f-7550-4680-a40f-27d175f54393 tempest-VolumesActionsTest-725112783 None] Acquiring lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642" by "attach_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4464f12f-7550-4680-a40f-27d175f54393 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642" acquired by "attach_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:13 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=61,cinder:INSERT=17,cinder:UPDATE=78,cinder:DELETE=5 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:26:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4464f12f-7550-4680-a40f-27d175f54393 tempest-VolumesActionsTest-725112783 None] Attaching volume 371b5a21-dba7-46e9-b686-39fc53541642 to instance a7404fa1-1613-4146-a045-c9ce176629c7 at mountpoint /dev/vdb on host None. Nov 02 14:26:14 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4464f12f-7550-4680-a40f-27d175f54393 tempest-VolumesActionsTest-725112783 None] Attach volume completed successfully. Nov 02 14:26:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4464f12f-7550-4680-a40f-27d175f54393 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642" released by "attach_volume" :: held 0.144s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-072282f7-9677-40ea-925f-018fbc318072 tempest-VolumesActionsTest-725112783 None] Acquiring lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-detach_volume" by "detach_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-072282f7-9677-40ea-925f-018fbc318072 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:14 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-072282f7-9677-40ea-925f-018fbc318072 tempest-VolumesActionsTest-725112783 None] Detaching volume 371b5a21-dba7-46e9-b686-39fc53541642 from instance a7404fa1-1613-4146-a045-c9ce176629c7. Nov 02 14:26:14 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-072282f7-9677-40ea-925f-018fbc318072 tempest-VolumesActionsTest-725112783 None] Detach volume completed successfully. Nov 02 14:26:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-072282f7-9677-40ea-925f-018fbc318072 tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:16 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Flow 'volume_create_manager' (cd3856f4-fe18-4e22-b80c-5865e89b3669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4629c3-6e2f-408f-a8eb-d2783718dad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4629c3-6e2f-408f-a8eb-d2783718dad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1700119874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e391725-d8a3-439a-9433-5a20456dcddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0dc25ee4078e4cb596e33a07570f995d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:26:17Z,use_quota=True,user_id='498a45407e64439b8530d8735c7f9608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e79a73-99ae-4800-a734-9472432f8e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e79a73-99ae-4800-a734-9472432f8e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acb9bc6-a1db-4d8b-acb2-77a4f11aea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5acb9bc6-a1db-4d8b-acb2-77a4f11aea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e391725-d8a3-439a-9433-5a20456dcddc', 'volume_name': 'volume-7e391725-d8a3-439a-9433-5a20456dcddc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4601745-c141-48e1-8361-31aac6e3f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4601745-c141-48e1-8361-31aac6e3f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf60e079-5ce0-44e9-ad04-851ed808be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:17 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Volume 7e391725-d8a3-439a-9433-5a20456dcddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e391725-d8a3-439a-9433-5a20456dcddc', 'volume_size': 1} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1700119874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e391725-d8a3-439a-9433-5a20456dcddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0dc25ee4078e4cb596e33a07570f995d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:26:17Z,use_quota=True,user_id='498a45407e64439b8530d8735c7f9608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Creating volume 7e391725-d8a3-439a-9433-5a20456dcddc {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:26:17 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:17 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc 1073741824 Nov 02 14:26:17 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:17 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc 1073741824" returned: 0 in 0.617s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:17 devstack sudo[93517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc Nov 02 14:26:17 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:18 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc" returned: 0 in 0.315s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:26:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:26:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf60e079-5ce0-44e9-ad04-851ed808be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e391725-d8a3-439a-9433-5a20456dcddc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f405f77a-8e29-45a0-95fd-48b095972ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Volume volume-7e391725-d8a3-439a-9433-5a20456dcddc (7e391725-d8a3-439a-9433-5a20456dcddc): created successfully Nov 02 14:26:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f405f77a-8e29-45a0-95fd-48b095972ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Flow 'volume_create_manager' (cd3856f4-fe18-4e22-b80c-5865e89b3669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:26:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-8fa31414-67ca-47e5-88ac-c1de3e8106ce req-0ecdfc38-2962-4db8-bef4-87c0e3ef9978 tempest-VolumesGetTestJSON-114952623 None] Created volume successfully. Nov 02 14:26:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Acquiring lock "cinder-7e391725-d8a3-439a-9433-5a20456dcddc-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Lock "cinder-7e391725-d8a3-439a-9433-5a20456dcddc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Acquiring lock "cinder-quobyte-7e391725-d8a3-439a-9433-5a20456dcddc" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:26:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Lock "cinder-quobyte-7e391725-d8a3-439a-9433-5a20456dcddc" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:26:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be8e9be-451a-4ec0-9534-0a5c79dead1f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:26:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:19 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc Nov 02 14:26:19 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:20 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc" returned: 0 in 0.559s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:20 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc Nov 02 14:26:20 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:20 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7e391725-d8a3-439a-9433-5a20456dcddc" returned: 0 in 0.498s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Lock "cinder-quobyte-7e391725-d8a3-439a-9433-5a20456dcddc" released by "delete_volume" :: held 1.163s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG cinder.quota [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Created reservations ['2bdb9856-1a74-4f39-a2c1-822e644853e5', 'affcc499-80a8-4882-82c2-6c9f6f0d7845', '85d993ea-635a-473f-91a3-b07d2ea126f1', '62fc3b7b-925b-4d82-915e-b7bf728c2851'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[215d17db-e357-40d9-92bc-8c832d65cc4e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:21 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:26:21 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:21 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:26:21 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:21 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG cinder.manager [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:26:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Deleted volume successfully. Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-26ee21f5-1394-4f46-815c-fa915c5f5dda req-9d9a4fe3-2e56-4988-93e6-566b063123c4 tempest-VolumesGetTestJSON-114952623 None] Lock "cinder-7e391725-d8a3-439a-9433-5a20456dcddc-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:26:21 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.593s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[338e5e99-d8d1-4f71-93b2-d9307534342e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:26:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:21 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:26:21 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:22 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.640s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.575d27f3-7f4b-47f7-8b00-51865e2a0c81ugyhj0hc.img {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:22 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.575d27f3-7f4b-47f7-8b00-51865e2a0c81ugyhj0hc.img Nov 02 14:26:22 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:31 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=9,cinder:UPDATE=15,cinder:INSERT=3 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:26:31 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.575d27f3-7f4b-47f7-8b00-51865e2a0c81ugyhj0hc.img" returned: 0 in 9.219s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:31 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfceabb-6392-470c-aa5f-13eb9a951913]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:26:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:31 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=63,cinder:UPDATE=61,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:26:31 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:26:31 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:32 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.678s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:32 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642, size 1024.00 MB, duration 9.22 sec, destination /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.575d27f3-7f4b-47f7-8b00-51865e2a0c81ugyhj0hc.img {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:26:32 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Converted 1024.00 MB image at 111.03 MB/s Nov 02 14:26:32 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] 575d27f3-7f4b-47f7-8b00-51865e2a0c81 was raw, no need to convert to raw {{(pid=86978) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 14:26:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-19ee03c3-2084-463d-801d-5d02c6d943ee tempest-GroupSnapshotsV319Test-1809619427 None] Group tempest-GroupSnapshotsV319Test-Group-1311300034: creating Nov 02 14:26:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-19ee03c3-2084-463d-801d-5d02c6d943ee tempest-GroupSnapshotsV319Test-1809619427 None] Group tempest-GroupSnapshotsV319Test-Group-1311300034: created successfully Nov 02 14:26:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-19ee03c3-2084-463d-801d-5d02c6d943ee tempest-GroupSnapshotsV319Test-1809619427 None] Create group completed successfully. Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Flow 'volume_create_manager' (7eb5b163-4755-4975-b2a8-d84b4a550fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a10708-2b40-4539-af32-c3406dfe216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a10708-2b40-4539-af32-c3406dfe216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338072377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44ef14f6-16fc-48ff-a301-ec7cba8fe548,host='devstack@QuobyteHD#QuobyteHD',id=a1eb0a91-4656-461e-9c86-0832a421ba99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30d2996b58f94a96a87d08476575b528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:26:37Z,use_quota=True,user_id='c9672356150c4f18b51b20fee6e6427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d58664-2456-49a4-a6e3-4e9c8467b66a),volume_type_id=c9d58664-2456-49a4-a6e3-4e9c8467b66a)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72aa04e4-82e5-43bf-a69e-59c46438bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72aa04e4-82e5-43bf-a69e-59c46438bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f80cbe-4886-42c5-a8dd-587170a8c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f80cbe-4886-42c5-a8dd-587170a8c7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1eb0a91-4656-461e-9c86-0832a421ba99', 'volume_name': 'volume-a1eb0a91-4656-461e-9c86-0832a421ba99', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30540d41-db01-44a6-be71-50bbb4467ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30540d41-db01-44a6-be71-50bbb4467ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5550965e-1d8d-4266-9484-749c49984f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:26:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Volume a1eb0a91-4656-461e-9c86-0832a421ba99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1eb0a91-4656-461e-9c86-0832a421ba99', 'volume_size': 1} Nov 02 14:26:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:26:39 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:26:39 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:26:39 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.433s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:26:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:26:46 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:26:46 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Flow 'volume_create_manager' (d86d5a88-70c8-475a-9db4-4604425fbc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4865ef18-ed97-4b86-be06-ce185c938f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4865ef18-ed97-4b86-be06-ce185c938f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1824945775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30e51d4-c70b-4889-8bb3-eeff404ac821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd02c62a9448828ae648fed16ac3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:03Z,use_quota=True,user_id='3f0fd7943fde473cbfb0656748bd5243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aed4593-ede0-4cb3-9488-f9f592c65f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aed4593-ede0-4cb3-9488-f9f592c65f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd02b7f2-5c82-4308-81dd-bcfda1ede390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd02b7f2-5c82-4308-81dd-bcfda1ede390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd30e51d4-c70b-4889-8bb3-eeff404ac821', 'volume_name': 'volume-d30e51d4-c70b-4889-8bb3-eeff404ac821', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d23fe-2d28-4667-b4f0-bd9bd72b8291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055d23fe-2d28-4667-b4f0-bd9bd72b8291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0f4663-6a71-43b8-a595-b0a758f2c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:02 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Volume d30e51d4-c70b-4889-8bb3-eeff404ac821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d30e51d4-c70b-4889-8bb3-eeff404ac821', 'volume_size': 1} Nov 02 14:27:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 46.701s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Uploaded volume to glance image-id: 575d27f3-7f4b-47f7-8b00-51865e2a0c81. {{(pid=86978) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.863s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=44ef14f6-16fc-48ff-a301-ec7cba8fe548,created_at=2026-11-02T13:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1338072377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44ef14f6-16fc-48ff-a301-ec7cba8fe548,host='devstack@QuobyteHD#QuobyteHD',id=a1eb0a91-4656-461e-9c86-0832a421ba99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30d2996b58f94a96a87d08476575b528',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:26:37Z,use_quota=True,user_id='c9672356150c4f18b51b20fee6e6427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9d58664-2456-49a4-a6e3-4e9c8467b66a),volume_type_id=c9d58664-2456-49a4-a6e3-4e9c8467b66a)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Creating volume a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:27:07 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:27:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:07 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 1073741824 Nov 02 14:27:07 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:07 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-385f9108-187e-477e-9333-9d4a12d82180 tempest-VolumesActionsTest-725112783 None] Copy volume to image completed successfully. Nov 02 14:27:08 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 1073741824" returned: 0 in 0.543s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:08 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 Nov 02 14:27:08 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:08 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99" returned: 0 in 0.255s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.685s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1824945775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30e51d4-c70b-4889-8bb3-eeff404ac821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd02c62a9448828ae648fed16ac3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:03Z,use_quota=True,user_id='3f0fd7943fde473cbfb0656748bd5243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Creating volume d30e51d4-c70b-4889-8bb3-eeff404ac821 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:27:08 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:08 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 1073741824 Nov 02 14:27:08 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5550965e-1d8d-4266-9484-749c49984f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1eb0a91-4656-461e-9c86-0832a421ba99', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de8826d-68fc-40b0-b431-ac370a0e302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:08 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Volume volume-a1eb0a91-4656-461e-9c86-0832a421ba99 (a1eb0a91-4656-461e-9c86-0832a421ba99): created successfully Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de8826d-68fc-40b0-b431-ac370a0e302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Flow 'volume_create_manager' (7eb5b163-4755-4975-b2a8-d84b4a550fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2a9ec6cf-60f4-4c3a-ba47-c3b2c1ab7f94 tempest-GroupSnapshotsV319Test-1809619427 None] Created volume successfully. Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:09 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 1073741824" returned: 0 in 0.498s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:09 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 Nov 02 14:27:09 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] GroupSnapshot c33999b2-b0b1-4fce-b0db-20a71ba53cc5: creating. Nov 02 14:27:09 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821" returned: 0 in 0.287s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.443s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0f4663-6a71-43b8-a595-b0a758f2c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d30e51d4-c70b-4889-8bb3-eeff404ac821', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19976712-bbee-4fd8-8c88-03062fed3a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b5e0f4-7daf-4a33-9e64-0866228347ee]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Group snapshot c33999b2-b0b1-4fce-b0db-20a71ba53cc5: creating. {{(pid=86978) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:09 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Volume volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 (d30e51d4-c70b-4889-8bb3-eeff404ac821): created successfully Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19976712-bbee-4fd8-8c88-03062fed3a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Flow 'volume_create_manager' (d86d5a88-70c8-475a-9db4-4604425fbc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a78f5c1c-efae-47a7-9367-6344e24ac5b5 tempest-ServersNegativeTestJSON-867253828 None] Created volume successfully. Nov 02 14:27:09 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:27:09 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:09 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.354s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed21650-ecc7-48e6-908c-8b1c05a1b888]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:09 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:27:09 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:10 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.367s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:10 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img Nov 02 14:27:10 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Flow 'volume_create_manager' (09b60f82-f3dc-4549-bb0e-e07c461c51ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7882bb-f19d-4e44-9233-86a3a4c42c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7882bb-f19d-4e44-9233-86a3a4c42c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1285535140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675551dbda4b4494be57aed2ece6fe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:11Z,use_quota=True,user_id='040fa1d18c60445f894a0a856e858c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c004a6c6-6024-4654-8e76-d754ca065cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c004a6c6-6024-4654-8e76-d754ca065cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece75274-3c6e-4ce5-9f2b-7218a494c9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece75274-3c6e-4ce5-9f2b-7218a494c9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7', 'volume_name': 'volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149e5e9a-ece9-4cc3-bb8b-3736fc21f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149e5e9a-ece9-4cc3-bb8b-3736fc21f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625a0a8a-a5ef-4793-8ed1-61c7822d5cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:11 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Volume 8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7', 'volume_size': 1} Nov 02 14:27:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Flow 'volume_create_manager' (3f8a17f5-6e60-404e-826d-75938dcc6f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f4fa40-3d4a-4f6a-ad00-a666fba8936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f4fa40-3d4a-4f6a-ad00-a666fba8936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235223571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4758420b-b2e3-4ed0-92a5-f93b2806d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd02c62a9448828ae648fed16ac3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:12Z,use_quota=True,user_id='3f0fd7943fde473cbfb0656748bd5243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cf7bca-3628-46e9-bfe0-21578daafbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cf7bca-3628-46e9-bfe0-21578daafbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4e744c-b244-48e6-92d8-25b26fb0a45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4e744c-b244-48e6-92d8-25b26fb0a45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4758420b-b2e3-4ed0-92a5-f93b2806d4a4', 'volume_name': 'volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d976f-fa1d-40f8-8315-5e12159455df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063d976f-fa1d-40f8-8315-5e12159455df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615bd72a-6a95-4667-940b-061d652d19a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:12 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Volume 4758420b-b2e3-4ed0-92a5-f93b2806d4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4', 'volume_size': 1} Nov 02 14:27:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:16 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img" returned: 0 in 6.501s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4fb9b-d6a2-4e45-80d3-79d335fbb75b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:16 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:27:16 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:17 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.514s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:27:17 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Converted 1024.00 MB image at 157.49 MB/s Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] 923fef32-9098-4a95-909b-f866478e24ee was raw, converting to qcow2 {{(pid=86978) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce0b45-4e07-41d9-96ea-5a561143df2e]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:17 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img Nov 02 14:27:17 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:17 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img" returned: 0 in 0.325s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:17 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img Nov 02 14:27:17 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:17 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img" returned: 1 in 0.314s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:27:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img /opt/stack/data/cinder/conversion/vol_upload_rj87lb6c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:17 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img /opt/stack/data/cinder/conversion/vol_upload_rj87lb6c Nov 02 14:27:17 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:18 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img /opt/stack/data/cinder/conversion/vol_upload_rj87lb6c" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:18 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Image conversion details: src /opt/stack/data/cinder/conversion/371b5a21-dba7-46e9-b686-39fc53541642.temp_image.923fef32-9098-4a95-909b-f866478e24eeal5rt3ax.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rj87lb6c {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:27:18 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 14:27:18 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b27591d-1ab1-49e4-afb8-5f2aac291a4a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rj87lb6c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:18 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rj87lb6c Nov 02 14:27:18 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:18 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rj87lb6c" returned: 0 in 0.322s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.292s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Uploaded volume to glance image-id: 923fef32-9098-4a95-909b-f866478e24ee. {{(pid=86978) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 14:27:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.234s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Creating offline snapshot 0aac3976-d6d5-4820-ae78-cab0cae675a5 of volume a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:27:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-67eb37fd-0c2a-4fab-af74-0b120220c7e1 tempest-VolumesActionsTest-725112783 None] Copy volume to image completed successfully. Nov 02 14:27:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad18495-1808-4232-a458-a7eba164eb37]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:19 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 Nov 02 14:27:19 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:20 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99" returned: 0 in 0.357s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:20 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 1G Nov 02 14:27:20 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:20 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 1G" returned: 0 in 0.395s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1eb0a91-4656-461e-9c86-0832a421ba99 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:20 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1eb0a91-4656-461e-9c86-0832a421ba99 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 Nov 02 14:27:20 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:20 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1eb0a91-4656-461e-9c86-0832a421ba99 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:20 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:27:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:20 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 Nov 02 14:27:20 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:21 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Acquiring lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:21 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.info Nov 02 14:27:21 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Acquiring lock "cinder-quobyte-371b5a21-dba7-46e9-b686-39fc53541642" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Lock "cinder-quobyte-371b5a21-dba7-46e9-b686-39fc53541642" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d165fb4-56dc-4628-ba8c-0958c901084c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:21 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:27:21 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:21 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.info" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:21 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:21 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.info Nov 02 14:27:21 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:21 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.369s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:21 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642 Nov 02 14:27:21 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:21 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.info" returned: 0 in 0.253s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.200s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1285535140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675551dbda4b4494be57aed2ece6fe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:11Z,use_quota=True,user_id='040fa1d18c60445f894a0a856e858c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Creating volume 8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:27:21 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:27:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:21 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 1073741824 Nov 02 14:27:21 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-99bef379-6dc9-49d0-9472-27c194483f87 tempest-GroupSnapshotsV319Test-1809619427 None] group_snapshot c33999b2-b0b1-4fce-b0db-20a71ba53cc5: created successfully Nov 02 14:27:22 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-371b5a21-dba7-46e9-b686-39fc53541642" returned: 0 in 0.336s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Lock "cinder-quobyte-371b5a21-dba7-46e9-b686-39fc53541642" released by "delete_volume" :: held 0.750s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Created reservations ['9ee99f3d-32ec-4b38-b210-18156381cf25', '210c1b3a-db02-4bb7-8042-ed669e8ed70f', '596c98ac-20b7-43f9-b74d-92fc3a857da4', 'f9b788cd-cdf0-4e51-9c36-5158ff36a2d9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:22 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:22 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:22 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 1073741824" returned: 0 in 0.603s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:22 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 Nov 02 14:27:22 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:22 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.349s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Deleted volume successfully. Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8e24e6e2-ef76-4c30-803a-f26eb897aeec tempest-VolumesActionsTest-725112783 None] Lock "cinder-371b5a21-dba7-46e9-b686-39fc53541642-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:22 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] group_snapshot c33999b2-b0b1-4fce-b0db-20a71ba53cc5: deleting Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7" returned: 0 in 0.298s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.072s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235223571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4758420b-b2e3-4ed0-92a5-f93b2806d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bd02c62a9448828ae648fed16ac3ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:12Z,use_quota=True,user_id='3f0fd7943fde473cbfb0656748bd5243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Creating volume 4758420b-b2e3-4ed0-92a5-f93b2806d4a4 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:27:22 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625a0a8a-a5ef-4793-8ed1-61c7822d5cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:22 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 1073741824 Nov 02 14:27:22 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277bf557-bd1c-4c2d-8a5d-69dddda81816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] group_snapshot c33999b2-b0b1-4fce-b0db-20a71ba53cc5: deleting {{(pid=86978) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 14:27:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Volume volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 (8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7): created successfully Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277bf557-bd1c-4c2d-8a5d-69dddda81816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Flow 'volume_create_manager' (09b60f82-f3dc-4549-bb0e-e07c461c51ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-bd48f753-e58b-4d76-8dee-e9782e194350 tempest-AttachVolumeTestJSON-987003269 None] Created volume successfully. Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Acquiring lock "cinder-quobyte-a1eb0a91-4656-461e-9c86-0832a421ba99" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "cinder-quobyte-a1eb0a91-4656-461e-9c86-0832a421ba99" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Acquiring lock "cinder-quobyte-0aac3976-d6d5-4820-ae78-cab0cae675a5" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "cinder-quobyte-0aac3976-d6d5-4820-ae78-cab0cae675a5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Deleting offline snapshot 0aac3976-d6d5-4820-ae78-cab0cae675a5 of volume a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] snapshot_file for this snap is: volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[454abec3-eddd-4b25-9395-a65971fb57c4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:23 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 Nov 02 14:27:23 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:23 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 1073741824" returned: 0 in 0.753s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:23 devstack sudo[94155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 Nov 02 14:27:23 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:23 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5" returned: 0 in 0.736s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1eb0a91-4656-461e-9c86-0832a421ba99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:27:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f136a8b2-15f6-4ca1-ae1b-08d04347fd4e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:24 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 Nov 02 14:27:24 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:24 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4" returned: 0 in 0.624s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615bd72a-6a95-4667-940b-061d652d19a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491fa8fa-6bdf-4792-a9a2-f0fe583bad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:24 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Volume volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 (4758420b-b2e3-4ed0-92a5-f93b2806d4a4): created successfully Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491fa8fa-6bdf-4792-a9a2-f0fe583bad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Flow 'volume_create_manager' (3f8a17f5-6e60-404e-826d-75938dcc6f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-be9d0cea-871f-43e8-a091-944caa854ce8 req-c839f607-47eb-40ab-911c-0808cb6ea62f tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-be9d0cea-871f-43e8-a091-944caa854ce8 req-c839f607-47eb-40ab-911c-0808cb6ea62f tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:24 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-43c6c5f4-e995-4f75-920c-054c06b717db tempest-ServersNegativeTestJSON-867253828 None] Created volume successfully. Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-be9d0cea-871f-43e8-a091-944caa854ce8 req-c839f607-47eb-40ab-911c-0808cb6ea62f tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-be9d0cea-871f-43e8-a091-944caa854ce8 req-c839f607-47eb-40ab-911c-0808cb6ea62f tempest-AttachVolumeTestJSON-987003269 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df224cbf-5316-4f76-8d7a-4ad773a587a8', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:27:24 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99" returned: 0 in 0.581s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:24 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 Nov 02 14:27:24 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:24 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-be9d0cea-871f-43e8-a091-944caa854ce8 req-c839f607-47eb-40ab-911c-0808cb6ea62f tempest-AttachVolumeTestJSON-987003269 None] attachment_update completed successfully. Nov 02 14:27:24 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5" returned: 0 in 0.440s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:24 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5 Nov 02 14:27:24 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:25 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99.0aac3976-d6d5-4820-ae78-cab0cae675a5" returned: 0 in 0.301s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "cinder-quobyte-0aac3976-d6d5-4820-ae78-cab0cae675a5" released by "_delete_snapshot" :: held 2.256s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Lock "cinder-quobyte-a1eb0a91-4656-461e-9c86-0832a421ba99" released by "delete_snapshot" :: held 2.291s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:25 devstack cinder-volume[86978]: WARNING cinder.quota [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1093682759 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1093682759, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:27:25 devstack cinder-volume[86978]: WARNING cinder.quota [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1093682759 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1093682759, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] Created reservations ['2152e268-cb6f-4c93-8a3a-bfe5956af844', '4df2d943-7cde-4548-9ad3-1a63a366278a', '0d86bd90-540d-4851-8a70-bd55d5ddcaa6', '099784cf-a66f-4f72-b77b-2929851dcf81'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-abfa63c4-5717-438d-b2e1-0b4391b1e619 tempest-GroupSnapshotsV319Test-1809619427 None] group_snapshot c33999b2-b0b1-4fce-b0db-20a71ba53cc5: deleted successfully Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "cinder-4758420b-b2e3-4ed0-92a5-f93b2806d4a4-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-4758420b-b2e3-4ed0-92a5-f93b2806d4a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Acquiring lock "cinder-quobyte-a1eb0a91-4656-461e-9c86-0832a421ba99" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "cinder-quobyte-4758420b-b2e3-4ed0-92a5-f93b2806d4a4" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Lock "cinder-quobyte-a1eb0a91-4656-461e-9c86-0832a421ba99" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-quobyte-4758420b-b2e3-4ed0-92a5-f93b2806d4a4" acquired by "delete_volume" :: waited 0.062s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c3c2f2-4415-458f-adff-f28b1722536b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[296f513a-2c5b-47d0-a7f2-a0c2d8186136]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:26 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 Nov 02 14:27:26 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:26 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 Nov 02 14:27:26 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:26 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:26 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99" returned: 0 in 0.452s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:26 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4 Nov 02 14:27:26 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:26 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99 Nov 02 14:27:26 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:26 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1eb0a91-4656-461e-9c86-0832a421ba99" returned: 0 in 0.280s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Lock "cinder-quobyte-a1eb0a91-4656-461e-9c86-0832a421ba99" released by "delete_volume" :: held 0.860s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:26 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4758420b-b2e3-4ed0-92a5-f93b2806d4a4" returned: 0 in 0.396s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-quobyte-4758420b-b2e3-4ed0-92a5-f93b2806d4a4" released by "delete_volume" :: held 0.882s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Created reservations ['30372fe2-89e3-4caf-9b58-bc63ed6e1f3b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:26 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Created reservations ['fdf37671-5d08-40f4-862b-fcb6d294134c', 'b6022319-3139-4fc6-a42b-c731d06a4dd7', '0bf5d067-f6eb-4ba5-9b42-14fba4672108', '89efb0e5-0ca7-4613-bac0-dcc4cf5d9a12'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:26 devstack cinder-volume[86978]: WARNING cinder.quota [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1093682759 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1093682759, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Created reservations ['cb5ec72c-de95-48f3-a350-19ca71a8beb6', '4c7e04ef-c7e8-48dc-b517-e5391617a124', '081ef022-2956-4a83-9485-0d31bdf9b0af', 'a2eeb375-227e-4ed3-9dda-d8b22578835b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Flow 'volume_create_manager' (d5818e25-3357-4a60-93ad-0980d9f7f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da0ffb1-f4d4-415d-abc1-2432625e5dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da0ffb1-f4d4-415d-abc1-2432625e5dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1349996457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298fbd10-ee81-483d-91cb-a466a5f84c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675551dbda4b4494be57aed2ece6fe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:27Z,use_quota=True,user_id='040fa1d18c60445f894a0a856e858c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaac47d-e8d4-4cab-952a-b8858cd99f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaac47d-e8d4-4cab-952a-b8858cd99f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:27 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:27 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3f584e-77da-499f-88c0-cbc7c9016c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3f584e-77da-499f-88c0-cbc7c9016c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298fbd10-ee81-483d-91cb-a466a5f84c51', 'volume_name': 'volume-298fbd10-ee81-483d-91cb-a466a5f84c51', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8243709-6905-4322-a092-5fe7ecc2c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8243709-6905-4322-a092-5fe7ecc2c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7e71b-aa26-439b-b699-2a091f3ee8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Volume 298fbd10-ee81-483d-91cb-a466a5f84c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298fbd10-ee81-483d-91cb-a466a5f84c51', 'volume_size': 1} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1349996457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298fbd10-ee81-483d-91cb-a466a5f84c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675551dbda4b4494be57aed2ece6fe1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:27Z,use_quota=True,user_id='040fa1d18c60445f894a0a856e858c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Creating volume 298fbd10-ee81-483d-91cb-a466a5f84c51 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:27:27 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:27 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 1073741824 Nov 02 14:27:27 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:27 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:27 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:27 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.342s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:27 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Deleted volume successfully. Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2298f18a-b026-41b5-a6d0-63ba1ce6149a tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-4758420b-b2e3-4ed0-92a5-f93b2806d4a4-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:27 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.297s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:27 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b658ff53-2e97-4182-b9e0-ba1c738efd8b tempest-GroupSnapshotsV319Test-1809619427 None] Delete group completed successfully. Nov 02 14:27:27 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 1073741824" returned: 0 in 0.495s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:27 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 Nov 02 14:27:27 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:28 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51" returned: 0 in 0.329s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7e71b-aa26-439b-b699-2a091f3ee8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298fbd10-ee81-483d-91cb-a466a5f84c51', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da952fec-980e-4d69-9ff4-c1288494e51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:28 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Volume volume-298fbd10-ee81-483d-91cb-a466a5f84c51 (298fbd10-ee81-483d-91cb-a466a5f84c51): created successfully Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da952fec-980e-4d69-9ff4-c1288494e51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Flow 'volume_create_manager' (d5818e25-3357-4a60-93ad-0980d9f7f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0c1bf54e-a8fd-486b-b502-7ddf1e412bb3 tempest-AttachVolumeTestJSON-987003269 None] Created volume successfully. Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "cinder-d30e51d4-c70b-4889-8bb3-eeff404ac821-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-d30e51d4-c70b-4889-8bb3-eeff404ac821-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "cinder-quobyte-d30e51d4-c70b-4889-8bb3-eeff404ac821" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-quobyte-d30e51d4-c70b-4889-8bb3-eeff404ac821" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b2ea03-b048-4bb6-95da-9124d91bb152]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:28 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 Nov 02 14:27:28 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:28 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821" returned: 0 in 0.407s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:28 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821 Nov 02 14:27:28 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:28 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d30e51d4-c70b-4889-8bb3-eeff404ac821" returned: 0 in 0.342s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-quobyte-d30e51d4-c70b-4889-8bb3-eeff404ac821" released by "delete_volume" :: held 0.820s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Created reservations ['8d866e1e-e9db-4e14-bf86-d82881dce261', '2bd48d7f-7b1b-4e4f-be46-703467022206', '15cd7a99-45c3-48b7-ac95-bd3e66aee7f6', 'd38d9a4e-5041-48a2-a13d-2e1ea1624dbd'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:29 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:29 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:29 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.443s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Deleted volume successfully. Nov 02 14:27:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-97491830-61b6-4053-bf8a-cf01fbe3d790 tempest-ServersNegativeTestJSON-867253828 None] Lock "cinder-d30e51d4-c70b-4889-8bb3-eeff404ac821-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-b0df8a0a-036e-47cc-bfcb-1d2ef27f485b req-b97e1315-742b-4fe5-8f4c-d3e26ae20c0e tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-b0df8a0a-036e-47cc-bfcb-1d2ef27f485b req-b97e1315-742b-4fe5-8f4c-d3e26ae20c0e tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-b0df8a0a-036e-47cc-bfcb-1d2ef27f485b req-b97e1315-742b-4fe5-8f4c-d3e26ae20c0e tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-b0df8a0a-036e-47cc-bfcb-1d2ef27f485b req-b97e1315-742b-4fe5-8f4c-d3e26ae20c0e tempest-AttachVolumeTestJSON-987003269 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-298fbd10-ee81-483d-91cb-a466a5f84c51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ebab74a-0b1a-4889-8479-9837a810b5a7', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:27:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-b0df8a0a-036e-47cc-bfcb-1d2ef27f485b req-b97e1315-742b-4fe5-8f4c-d3e26ae20c0e tempest-AttachVolumeTestJSON-987003269 None] attachment_update completed successfully. Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Flow 'volume_create_manager' (4e8ec7bc-e552-4f32-9b62-bdcfa553afc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e419f92-3b27-40ef-a05c-40714a5adf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e419f92-3b27-40ef-a05c-40714a5adf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1338082082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c2a13a-3f95-4fe9-b86d-ba3b7a86754b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd828674f5241918e4953e394507929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:34Z,use_quota=True,user_id='5f01dbfcfa9b47f39f61288c05493011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab05a23-e240-4a2d-bcaf-3089399b21e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ab05a23-e240-4a2d-bcaf-3089399b21e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e04cbea-fafd-477c-bba7-a8f8b0a4051a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e04cbea-fafd-477c-bba7-a8f8b0a4051a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92c2a13a-3f95-4fe9-b86d-ba3b7a86754b', 'volume_name': 'volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc8f966-c888-4f0c-b6d5-a4f012f48cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc8f966-c888-4f0c-b6d5-a4f012f48cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e9aa35-a4e7-45f4-b47f-fcd0ad0f1278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:34 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Volume 92c2a13a-3f95-4fe9-b86d-ba3b7a86754b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b', 'volume_size': 1} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1338082082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92c2a13a-3f95-4fe9-b86d-ba3b7a86754b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd828674f5241918e4953e394507929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:34Z,use_quota=True,user_id='5f01dbfcfa9b47f39f61288c05493011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Creating volume 92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:27:34 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-2fd4b4b7-d3ac-4db1-bcf2-fd5e0147ade2 req-e2b8da2b-2fff-42e0-ba3d-4b688d493a4e tempest-AttachVolumeTestJSON-987003269 None] Terminate volume connection completed successfully. Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-2fd4b4b7-d3ac-4db1-bcf2-fd5e0147ade2 req-e2b8da2b-2fff-42e0-ba3d-4b688d493a4e tempest-AttachVolumeTestJSON-987003269 None] Deleting attachment df224cbf-5316-4f76-8d7a-4ad773a587a8. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:27:34 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b 1073741824 Nov 02 14:27:34 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:34 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b 1073741824" returned: 0 in 0.577s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:35 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b Nov 02 14:27:35 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:35 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" returned: 0 in 0.314s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e9aa35-a4e7-45f4-b47f-fcd0ad0f1278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670b10f8-d1ed-4b95-88ee-41122a870c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Volume volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b (92c2a13a-3f95-4fe9-b86d-ba3b7a86754b): created successfully Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (670b10f8-d1ed-4b95-88ee-41122a870c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Flow 'volume_create_manager' (4e8ec7bc-e552-4f32-9b62-bdcfa553afc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3c5a71ab-e517-4dfa-a8b5-dffe6611da57 tempest-VolumesCloneTest-1804686252 None] Created volume successfully. Nov 02 14:27:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-49802dd1-ce7f-469e-bbad-76d93355447e req-f88379cb-2320-46de-856d-fb7f4c7881ba tempest-AttachVolumeTestJSON-987003269 None] Terminate volume connection completed successfully. Nov 02 14:27:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-49802dd1-ce7f-469e-bbad-76d93355447e req-f88379cb-2320-46de-856d-fb7f4c7881ba tempest-AttachVolumeTestJSON-987003269 None] Deleting attachment 0ebab74a-0b1a-4889-8479-9837a810b5a7. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:27:36 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:27:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Flow 'volume_create_manager' (49934802-4418-457a-91e1-c9e13c1c6ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68deff44-012c-4821-99b0-18ba291ec0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68deff44-012c-4821-99b0-18ba291ec0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-309347777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26b8362-5730-4a7c-9062-c3017be8b88b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd828674f5241918e4953e394507929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=92c2a13a-3f95-4fe9-b86d-ba3b7a86754b,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:37Z,use_quota=True,user_id='5f01dbfcfa9b47f39f61288c05493011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3156c01-21bf-4a7f-9b2e-00332ed83e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3156c01-21bf-4a7f-9b2e-00332ed83e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e754c98-dad6-49de-b51b-01ccd875ce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e754c98-dad6-49de-b51b-01ccd875ce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f26b8362-5730-4a7c-9062-c3017be8b88b', 'volume_name': 'volume-f26b8362-5730-4a7c-9062-c3017be8b88b', 'volume_size': 2, 'source_volid': '92c2a13a-3f95-4fe9-b86d-ba3b7a86754b', 'source_volstatus': 'available'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3df5e0a-24ab-4b51-b26f-9ee378044bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3df5e0a-24ab-4b51-b26f-9ee378044bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1058e5-77f4-415f-9d2a-2ee01ca21e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:37 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Volume f26b8362-5730-4a7c-9062-c3017be8b88b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f26b8362-5730-4a7c-9062-c3017be8b88b', 'volume_size': 2, 'source_volid': '92c2a13a-3f95-4fe9-b86d-ba3b7a86754b', 'source_volstatus': 'available'} Nov 02 14:27:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f11e6a57-0b2e-4c85-93d5-02a35499afe3 tempest-GroupsV320Test-1016129607 None] Group tempest-GroupsV320Test-Group-21117508: creating Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:37 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Cloning volume 92c2a13a-3f95-4fe9-b86d-ba3b7a86754b to volume f26b8362-5730-4a7c-9062-c3017be8b88b Nov 02 14:27:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f11e6a57-0b2e-4c85-93d5-02a35499afe3 tempest-GroupsV320Test-1016129607 None] Group tempest-GroupsV320Test-Group-21117508: created successfully Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Creating offline snapshot 628b0576-4bc7-49fb-ac31-14707f5fc656 of volume 92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:27:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f11e6a57-0b2e-4c85-93d5-02a35499afe3 tempest-GroupsV320Test-1016129607 None] Create group completed successfully. Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7998fe4-058d-4081-b8b4-e247f691f69f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:37 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b Nov 02 14:27:37 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:37 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" returned: 0 in 0.483s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:37 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 1G Nov 02 14:27:37 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:38 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 1G" returned: 0 in 0.667s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:38 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 Nov 02 14:27:38 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:38 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656" returned: 0 in 0.434s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:38 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 is being set with open permissions: ugo+rw Nov 02 14:27:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:38 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 Nov 02 14:27:38 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:38 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Created reservations ['52aaf736-fc12-4830-a12e-3f58ef078005'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:39 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:39 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:39 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:39 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:39 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656" returned: 0 in 0.442s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:39 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.info Nov 02 14:27:39 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:39 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:39 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-58f016a8-1ac9-46d4-92e2-460ebff0cb43 tempest-GroupsV320Test-1016129607 None] Delete group completed successfully. Nov 02 14:27:39 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.377s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:27:39 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.info" returned: 0 in 0.372s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:39 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.info is being set with open permissions: ugo+rw Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:39 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.info Nov 02 14:27:39 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:39 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.info" returned: 0 in 0.282s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:39 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "cinder-quobyte-f26b8362-5730-4a7c-9062-c3017be8b88b" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-f26b8362-5730-4a7c-9062-c3017be8b88b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] snapshot: 628b0576-4bc7-49fb-ac31-14707f5fc656, volume: f26b8362-5730-4a7c-9062-c3017be8b88b, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff9505-3363-4097-9d8d-3513e4afa2f2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:40 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 Nov 02 14:27:40 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:40 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656" returned: 0 in 0.545s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e9cb57-5dfc-4c78-a92c-6c1b7fae371e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:40 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b Nov 02 14:27:40 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:41 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" returned: 0 in 0.625s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:27:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:27:41 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:27:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:41 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b Nov 02 14:27:41 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "cinder-298fbd10-ee81-483d-91cb-a466a5f84c51-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-298fbd10-ee81-483d-91cb-a466a5f84c51-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "cinder-quobyte-298fbd10-ee81-483d-91cb-a466a5f84c51" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-quobyte-298fbd10-ee81-483d-91cb-a466a5f84c51" acquired by "delete_volume" :: waited 0.049s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:45 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6dd9a4-8478-4b8f-9c51-08b6962b8c94]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:45 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 Nov 02 14:27:45 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:45 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51" returned: 0 in 0.885s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:46 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51 Nov 02 14:27:46 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:46 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-298fbd10-ee81-483d-91cb-a466a5f84c51" returned: 0 in 0.559s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-quobyte-298fbd10-ee81-483d-91cb-a466a5f84c51" released by "delete_volume" :: held 1.585s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Created reservations ['c52450a2-77aa-4123-9331-15bad0492e3f', '5ac08849-3840-4607-816b-227b4d8153a4', '0ee80c4f-9651-4a54-b67c-6d665914e633', '5e353b8b-df5b-4870-babe-875643ada661'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:46 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:46 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "cinder-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "cinder-quobyte-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-quobyte-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7" acquired by "delete_volume" :: waited 0.052s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:47 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.786s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c6186a-c11b-48a4-862f-fad228c538d9]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Deleted volume successfully. Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cdbe4cf4-c89f-49a3-83aa-a03f3c3e7a9e tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-298fbd10-ee81-483d-91cb-a466a5f84c51-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:47 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 Nov 02 14:27:47 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:48 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7" returned: 0 in 0.728s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:48 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7 Nov 02 14:27:48 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:48 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7" returned: 0 in 0.539s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-quobyte-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7" released by "delete_volume" :: held 1.400s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Created reservations ['70e2293c-cfbe-4c51-85e0-e15ae6850bc8', '31683a65-c74d-491e-9489-41e643562b48', '681f6d9b-c69b-402d-b32e-a745b663eda9', '48b2cd80-cfc9-4235-81fd-9ddc4f17a9a8'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:49 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:49 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:49 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.523s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Deleted volume successfully. Nov 02 14:27:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7ffdbafd-ed74-477d-85fb-afdea9082d20 tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-8bf5f570-36a7-4ec8-a9c8-2bb67c4750d7-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "cinder-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "cinder-quobyte-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-quobyte-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:50 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[509c0439-4bde-497b-b9e6-dd8c350b0655]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:50 devstack sudo[94833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c Nov 02 14:27:50 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:51 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b" returned: 0 in 9.727s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:27:51 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Converted 1024.00 MB image at 105.24 MB/s Nov 02 14:27:51 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b is being set with open permissions: ugo+rw Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:51 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c" returned: 0 in 0.741s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:51 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b Nov 02 14:27:51 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:51 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c Nov 02 14:27:51 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:51 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b" returned: 0 in 0.357s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-f26b8362-5730-4a7c-9062-c3017be8b88b" released by "_copy_volume_from_snapshot" :: held 11.399s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "cinder-quobyte-628b0576-4bc7-49fb-ac31-14707f5fc656" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:51 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-628b0576-4bc7-49fb-ac31-14707f5fc656" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Deleting offline snapshot 628b0576-4bc7-49fb-ac31-14707f5fc656 of volume 92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] snapshot_file for this snap is: volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c" returned: 0 in 0.405s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-quobyte-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c" released by "delete_volume" :: held 1.235s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4cb38e-a0c4-4ee1-ae8c-5aa3149e3449]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Created reservations ['1ed11fe9-4174-47ca-9f78-320b0682800a', 'fe626723-a75d-43f9-90d9-36e6bffa8e86', '3de547be-42d0-4ca1-a829-9f02415ce120', '826bbc5a-c83c-4cc1-be13-12e9ea53ea1d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:51 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 Nov 02 14:27:51 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:51 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:51 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:51 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656" returned: 0 in 0.420s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5f497-21e5-45ff-8271-7c4eb6bb57e7]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:51 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:51 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Deleted volume successfully. Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c6458c4-6abd-45e2-919d-65423ac333ec tempest-AttachVolumeTestJSON-987003269 None] Lock "cinder-0fe1b0f5-3bb9-426b-a983-509e9b6dda1c-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:52 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b Nov 02 14:27:52 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:52 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" returned: 0 in 0.749s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:52 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 Nov 02 14:27:52 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Flow 'volume_create_manager' (d86af315-825c-4ce6-b767-9d0e8855d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3692159-4367-42d2-a82a-59cf93819ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3692159-4367-42d2-a82a-59cf93819ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1468592177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc69277-ff86-45d0-87e3-66572db0001e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b6bd2cfff64b36ac4f343bcdfbf4ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:53Z,use_quota=True,user_id='e24eead032334a16a8543dee07ce8ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f5c037-86ae-4d45-b45f-50137a4dab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f5c037-86ae-4d45-b45f-50137a4dab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d627d34-91df-4ba3-b054-463f400ab80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d627d34-91df-4ba3-b054-463f400ab80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc69277-ff86-45d0-87e3-66572db0001e', 'volume_name': 'volume-3dc69277-ff86-45d0-87e3-66572db0001e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c398f5e3-30d0-47ef-bc94-eb80ecba746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c398f5e3-30d0-47ef-bc94-eb80ecba746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeef57f-0602-4717-a0d0-d531e9f15f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:52 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Volume 3dc69277-ff86-45d0-87e3-66572db0001e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc69277-ff86-45d0-87e3-66572db0001e', 'volume_size': 1} Nov 02 14:27:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:53 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656" returned: 0 in 0.477s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:53 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656 Nov 02 14:27:53 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:53 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b.628b0576-4bc7-49fb-ac31-14707f5fc656" returned: 0 in 0.276s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-628b0576-4bc7-49fb-ac31-14707f5fc656" released by "_delete_snapshot" :: held 2.063s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.440s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1468592177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc69277-ff86-45d0-87e3-66572db0001e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b6bd2cfff64b36ac4f343bcdfbf4ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:27:53Z,use_quota=True,user_id='e24eead032334a16a8543dee07ce8ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Creating volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:27:53 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1058e5-77f4-415f-9d2a-2ee01ca21e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f26b8362-5730-4a7c-9062-c3017be8b88b', 'volume_size': 2, 'source_volid': '92c2a13a-3f95-4fe9-b86d-ba3b7a86754b', 'source_volstatus': 'available'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28965b6-dfcd-4b81-a581-95fee4a1b42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:53 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e 1073741824 Nov 02 14:27:53 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:53 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Volume volume-f26b8362-5730-4a7c-9062-c3017be8b88b (f26b8362-5730-4a7c-9062-c3017be8b88b): created successfully Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28965b6-dfcd-4b81-a581-95fee4a1b42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Flow 'volume_create_manager' (49934802-4418-457a-91e1-c9e13c1c6ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7954013d-95ce-4af9-908f-ff19438c2a77 tempest-VolumesCloneTest-1804686252 None] Created volume successfully. Nov 02 14:27:54 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e 1073741824" returned: 0 in 0.658s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:54 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e Nov 02 14:27:54 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "cinder-f26b8362-5730-4a7c-9062-c3017be8b88b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-f26b8362-5730-4a7c-9062-c3017be8b88b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "cinder-quobyte-f26b8362-5730-4a7c-9062-c3017be8b88b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-f26b8362-5730-4a7c-9062-c3017be8b88b" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ed1d59-5652-4d20-9a30-1eb42934ee0d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:54 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e" returned: 0 in 0.385s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:54 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b Nov 02 14:27:54 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeef57f-0602-4717-a0d0-d531e9f15f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc69277-ff86-45d0-87e3-66572db0001e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcd4ab4-e344-4add-909c-f994262c68f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:27:54 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Volume volume-3dc69277-ff86-45d0-87e3-66572db0001e (3dc69277-ff86-45d0-87e3-66572db0001e): created successfully Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffcd4ab4-e344-4add-909c-f994262c68f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:27:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Flow 'volume_create_manager' (d86af315-825c-4ce6-b767-9d0e8855d678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:27:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ab397282-77fa-4a7c-b0d9-fd27d6ca8014 tempest-SnapshotsActionsTest-267937541 None] Created volume successfully. Nov 02 14:27:55 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b" returned: 0 in 0.495s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:55 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b Nov 02 14:27:55 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Creating offline snapshot 4c2bbbf8-c124-4b18-9ee9-67da06bea61d of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bd04b2-9479-4c5d-bc1e-ab147c7c76e4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:55 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f26b8362-5730-4a7c-9062-c3017be8b88b" returned: 0 in 0.335s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-f26b8362-5730-4a7c-9062-c3017be8b88b" released by "delete_volume" :: held 0.879s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:55 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e Nov 02 14:27:55 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Created reservations ['5b3b6636-cd83-4285-9d22-8ad379cff043', 'f74eb0dd-d36a-4a64-a14f-5677796fac1c', '13f7bb75-4480-48a3-a224-e2cd59f02728', '38950da8-5803-4dff-8c27-c82f4f55ff00'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:55 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:55 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "cinder-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:55 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e" returned: 0 in 0.580s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:55 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d 1G Nov 02 14:27:55 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "cinder-quobyte-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed97d44-ce6e-4a13-8860-b3dd90b246db]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:56 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.435s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:56 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Deleted volume successfully. Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8dd19722-3517-480f-94be-bb42932ee9b5 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-f26b8362-5730-4a7c-9062-c3017be8b88b-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:56 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b Nov 02 14:27:56 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:56 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d 1G" returned: 0 in 0.543s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:56 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:27:56 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:56 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" returned: 0 in 0.476s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:56 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b Nov 02 14:27:56 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:56 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.343s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:56 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d is being set with open permissions: ugo+rw Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:56 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:27:56 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:56 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" returned: 0 in 0.324s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-quobyte-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b" released by "delete_volume" :: held 0.911s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=107,cinder:UPDATE=115,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:27:56 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=96,cinder:UPDATE=103,cinder:INSERT=31,cinder:DELETE=9 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Created reservations ['ecafc7c2-c0bc-47d7-bb24-35e18da9363e', 'fffc4c0b-b464-4a9a-9faf-d50eca7bb9ca', 'faac9a7a-ce4e-4a67-8476-91b2f4caba29', '701ec0c5-b5db-48c3-b739-b9a06daec615'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:57 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.385s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:57 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:27:57 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:57 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.info Nov 02 14:27:57 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:57 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.331s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:27:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Deleted volume successfully. Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8edb993-c046-49ed-b181-60044ab49a38 tempest-VolumesCloneTest-1804686252 None] Lock "cinder-92c2a13a-3f95-4fe9-b86d-ba3b7a86754b-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:27:57 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.info" returned: 0 in 0.366s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:57 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.info is being set with open permissions: ugo+rw Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:57 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.info Nov 02 14:27:57 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:57 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.info" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:27:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-20e5d93a-9cdc-4616-8c83-47dfa326e358 tempest-SnapshotsActionsTest-267937541 None] Create snapshot completed successfully Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Creating offline snapshot 38a2cb62-235f-4626-8195-77155916e3ac of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c558da81-ffeb-4356-8c28-4b0513ba4f1c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:59 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:27:59 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:27:59 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.427s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:27:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:27:59 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac 1G Nov 02 14:27:59 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:00 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac 1G" returned: 0 in 0.703s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:00 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac Nov 02 14:28:00 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:00 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac" returned: 0 in 0.472s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:00 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac is being set with open permissions: ugo+rw Nov 02 14:28:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:01 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac Nov 02 14:28:01 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:01 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac" returned: 0 in 0.263s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:01 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6524c4c3-18d4-4f94-92fd-f3d762c5a933 tempest-SnapshotsActionsTest-267937541 None] Create snapshot completed successfully Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-38a2cb62-235f-4626-8195-77155916e3ac-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-38a2cb62-235f-4626-8195-77155916e3ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-38a2cb62-235f-4626-8195-77155916e3ac" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-38a2cb62-235f-4626-8195-77155916e3ac" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Deleting offline snapshot 38a2cb62-235f-4626-8195-77155916e3ac of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] snapshot_file for this snap is: volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc8b751-ad3b-41ce-89d2-5dba5a7a2892]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:01 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac Nov 02 14:28:01 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:02 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac" returned: 0 in 0.421s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:02 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6c93cf-549d-46b7-a617-863b13a5749a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:02 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:02 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:02 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.493s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:02 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac Nov 02 14:28:02 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:03 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac" returned: 0 in 0.521s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:03 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac Nov 02 14:28:03 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:03 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.38a2cb62-235f-4626-8195-77155916e3ac" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-38a2cb62-235f-4626-8195-77155916e3ac" released by "_delete_snapshot" :: held 1.879s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" released by "delete_snapshot" :: held 1.912s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:03 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Created reservations ['c2638f39-097d-4c87-829f-1b7a0791c0f6', 'c7a9efed-69be-4b05-9dff-dca1affb9e57', 'e2f02a25-3850-43de-82bb-7436f201bc2c', '6b7e3b2c-98f6-4c26-a642-45973662d244'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Delete snapshot completed successfully. Nov 02 14:28:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a65e6ec-5c01-4632-9c5d-c99e069ef712 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-38a2cb62-235f-4626-8195-77155916e3ac-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Flow 'volume_create_manager' (1d0cc3d4-fc87-4577-bdd9-7fb20fee0abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39bcb54c-2ba4-400f-896b-419fd7bc5101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39bcb54c-2ba4-400f-896b-419fd7bc5101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1336688868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5100f33-10d0-4b93-8624-6ecfef9355e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd93029fdae94b5e984647055020caab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:04Z,use_quota=True,user_id='00412da5e7d94565a2595fd0ffacd061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f521a13d-7590-4d4d-8fb7-9032912db509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f521a13d-7590-4d4d-8fb7-9032912db509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcab89e4-0a36-4233-ab54-5ce56daf98ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcab89e4-0a36-4233-ab54-5ce56daf98ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5100f33-10d0-4b93-8624-6ecfef9355e2', 'volume_name': 'volume-d5100f33-10d0-4b93-8624-6ecfef9355e2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9ab048-20fc-4313-b08e-7cf11833cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9ab048-20fc-4313-b08e-7cf11833cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cd5ef2-fa89-46ac-9c6d-3952467bce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Volume d5100f33-10d0-4b93-8624-6ecfef9355e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5100f33-10d0-4b93-8624-6ecfef9355e2', 'volume_size': 1} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1336688868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5100f33-10d0-4b93-8624-6ecfef9355e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd93029fdae94b5e984647055020caab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:04Z,use_quota=True,user_id='00412da5e7d94565a2595fd0ffacd061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Creating volume d5100f33-10d0-4b93-8624-6ecfef9355e2 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:04 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:04 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 1073741824 Nov 02 14:28:04 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Flow 'volume_create_manager' (7841d7b2-5e26-4b65-9bb2-beffa536074a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89f8529-55b5-4e65-be7f-d352b040f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89f8529-55b5-4e65-be7f-d352b040f50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1644662626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d680d6-425e-4807-a2f9-5b748cf6db27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12667a28fe6f4917a54bf3c6f228ece8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:04Z,use_quota=True,user_id='d3baff463c0947b690d83cb845086522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6247dba5-2598-429a-b35f-5e8856883623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6247dba5-2598-429a-b35f-5e8856883623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be37b5e1-9c9e-4365-aa44-cc563c1af053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be37b5e1-9c9e-4365-aa44-cc563c1af053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d680d6-425e-4807-a2f9-5b748cf6db27', 'volume_name': 'volume-40d680d6-425e-4807-a2f9-5b748cf6db27', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b596699-8429-43e9-b798-aa22322b6e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b596699-8429-43e9-b798-aa22322b6e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01a2fce-0842-459d-9a92-3cdc77f98952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:04 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Volume 40d680d6-425e-4807-a2f9-5b748cf6db27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d680d6-425e-4807-a2f9-5b748cf6db27', 'volume_size': 1} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:04 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 1073741824" returned: 0 in 0.490s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:04 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 Nov 02 14:28:04 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:05 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2" returned: 0 in 0.260s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.560s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cd5ef2-fa89-46ac-9c6d-3952467bce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5100f33-10d0-4b93-8624-6ecfef9355e2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b3044e-c71d-4e9b-8bb7-b51b6dd0aab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Creating offline snapshot 5a462277-6bb7-4deb-bf51-5d686fe68d20 of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:28:05 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Volume volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 (d5100f33-10d0-4b93-8624-6ecfef9355e2): created successfully Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b3044e-c71d-4e9b-8bb7-b51b6dd0aab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Flow 'volume_create_manager' (1d0cc3d4-fc87-4577-bdd9-7fb20fee0abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6904ee7b-574d-45ba-99a9-1f5dffda4b30]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:05 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d9fd983a-4368-46f0-9a4d-3f735f791abb tempest-VolumesNegativeTest-1071157322 None] Created volume successfully. Nov 02 14:28:05 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:05 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:05 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.420s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:05 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 1G Nov 02 14:28:05 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:06 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 1G" returned: 0 in 0.527s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:06 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 Nov 02 14:28:06 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:06 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:06 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 is being set with open permissions: ugo+rw Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:06 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 Nov 02 14:28:06 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:06 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20" returned: 0 in 0.350s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.348s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1644662626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d680d6-425e-4807-a2f9-5b748cf6db27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12667a28fe6f4917a54bf3c6f228ece8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:04Z,use_quota=True,user_id='d3baff463c0947b690d83cb845086522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Creating volume 40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:06 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:06 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 1073741824 Nov 02 14:28:06 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b930c89e-b6d4-4d27-9388-036957a90f05 tempest-SnapshotsActionsTest-267937541 None] Create snapshot completed successfully Nov 02 14:28:07 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 1073741824" returned: 0 in 0.648s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:07 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 Nov 02 14:28:07 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-5a462277-6bb7-4deb-bf51-5d686fe68d20-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-5a462277-6bb7-4deb-bf51-5d686fe68d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-5a462277-6bb7-4deb-bf51-5d686fe68d20" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-5a462277-6bb7-4deb-bf51-5d686fe68d20" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Deleting offline snapshot 5a462277-6bb7-4deb-bf51-5d686fe68d20 of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] snapshot_file for this snap is: volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[15df1aa1-fac6-4525-85ba-88458a5f2c00]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:08 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27" returned: 0 in 0.463s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:08 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 Nov 02 14:28:08 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01a2fce-0842-459d-9a92-3cdc77f98952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d680d6-425e-4807-a2f9-5b748cf6db27', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56cd368-2895-4596-a8b7-7bf44d837583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:08 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Volume volume-40d680d6-425e-4807-a2f9-5b748cf6db27 (40d680d6-425e-4807-a2f9-5b748cf6db27): created successfully Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56cd368-2895-4596-a8b7-7bf44d837583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Flow 'volume_create_manager' (7841d7b2-5e26-4b65-9bb2-beffa536074a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-467cfdff-0f4b-473c-859d-702a03fdd8dd req-78051fb8-6bec-46fb-ac41-1173156c02bc tempest-VolumesSnapshotsTestJSON-189238304 None] Created volume successfully. Nov 02 14:28:08 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20" returned: 0 in 0.674s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c949c08-cf4f-449c-9b10-2722edef1c4f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:08 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:08 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Creating offline snapshot ad494515-31e9-4864-9313-b8fa9b44fa29 of volume 40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8398fcdd-d844-4636-af4a-e8c2b098d025]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:09 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.539s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:09 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 Nov 02 14:28:09 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:09 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 Nov 02 14:28:09 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:09 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27" returned: 0 in 0.650s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:09 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 1G Nov 02 14:28:09 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:09 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20" returned: 0 in 0.734s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:09 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20 Nov 02 14:28:09 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:10 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.5a462277-6bb7-4deb-bf51-5d686fe68d20" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-5a462277-6bb7-4deb-bf51-5d686fe68d20" released by "_delete_snapshot" :: held 2.527s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" released by "delete_snapshot" :: held 2.562s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:10 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Created reservations ['b1729caa-3952-44b4-9f45-7949ea38291a', '577f102b-5ba1-418a-94b1-6d35a23c053c', '48077fa7-89ea-4789-ace8-a3bbc2a4a2c0', '8af02ba1-f91a-4d37-9c18-55664ea74427'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:10 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 1G" returned: 0 in 0.743s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d680d6-425e-4807-a2f9-5b748cf6db27 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:10 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Delete snapshot completed successfully. Nov 02 14:28:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0e78e849-acfe-48d2-acd4-2b602e260f72 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-5a462277-6bb7-4deb-bf51-5d686fe68d20-delete_snapshot" released by "delete_snapshot" :: held 2.807s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:10 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d680d6-425e-4807-a2f9-5b748cf6db27 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 Nov 02 14:28:10 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:10 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d680d6-425e-4807-a2f9-5b748cf6db27 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29" returned: 0 in 0.467s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:11 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 is being set with open permissions: ugo+rw Nov 02 14:28:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:11 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 Nov 02 14:28:11 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:11 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29" returned: 0 in 0.510s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:11 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.info Nov 02 14:28:11 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:12 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.info" returned: 0 in 0.543s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:12 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.info is being set with open permissions: ugo+rw Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:12 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.info Nov 02 14:28:12 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:12 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.info" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.510s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.880s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Creating offline snapshot f44c88c8-ced5-438f-9dc7-c45b47c60f43 of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:28:12 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-bc61cde6-4529-4456-808f-9cbc036e0d25 req-9ad7f85a-adbc-49c2-9483-73beac27f5cf tempest-VolumesSnapshotsTestJSON-189238304 None] Create snapshot completed successfully Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7ed460-ff42-4458-8455-d1da1c07af25]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:13 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:13 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:13 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.508s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:13 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:13 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 1G Nov 02 14:28:13 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "cinder-ad494515-31e9-4864-9313-b8fa9b44fa29-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-ad494515-31e9-4864-9313-b8fa9b44fa29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "cinder-quobyte-40d680d6-425e-4807-a2f9-5b748cf6db27" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-quobyte-40d680d6-425e-4807-a2f9-5b748cf6db27" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "cinder-quobyte-ad494515-31e9-4864-9313-b8fa9b44fa29" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-quobyte-ad494515-31e9-4864-9313-b8fa9b44fa29" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Deleting offline snapshot ad494515-31e9-4864-9313-b8fa9b44fa29 of volume 40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] snapshot_file for this snap is: volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5857e3-f6ae-43e6-b640-701be7c1e488]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:14 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 1G" returned: 0 in 1.142s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:14 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 Nov 02 14:28:14 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:14 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 Nov 02 14:28:14 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:15 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43" returned: 0 in 0.785s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:15 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 is being set with open permissions: ugo+rw Nov 02 14:28:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:15 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 Nov 02 14:28:15 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:15 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29" returned: 0 in 1.064s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40d680d6-425e-4807-a2f9-5b748cf6db27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[99887939-80d6-4582-a98f-7b47906bd78b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:15 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 Nov 02 14:28:15 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43" returned: 0 in 0.685s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:15 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.425s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3a0172ed-02c5-4858-8fc9-51ed688f56d2 tempest-SnapshotsActionsTest-267937541 None] Create snapshot completed successfully Nov 02 14:28:16 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27" returned: 0 in 0.793s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:16 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 Nov 02 14:28:16 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:16 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29" returned: 0 in 0.546s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:16 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29 Nov 02 14:28:16 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:17 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27.ad494515-31e9-4864-9313-b8fa9b44fa29" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-quobyte-ad494515-31e9-4864-9313-b8fa9b44fa29" released by "_delete_snapshot" :: held 3.000s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-quobyte-40d680d6-425e-4807-a2f9-5b748cf6db27" released by "delete_snapshot" :: held 3.059s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-f44c88c8-ced5-438f-9dc7-c45b47c60f43-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.quota [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Created reservations ['ced116aa-643f-4f4f-80e9-750697eabaf8', '02c65301-cb3e-4a65-bd20-aea0f9e7858e', '7edfa0a7-b043-422b-9338-86d68523b7d7', 'bbc95307-237b-4e5f-ba53-6e7e94b67f9c'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-f44c88c8-ced5-438f-9dc7-c45b47c60f43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-f44c88c8-ced5-438f-9dc7-c45b47c60f43" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-f44c88c8-ced5-438f-9dc7-c45b47c60f43" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Deleting offline snapshot f44c88c8-ced5-438f-9dc7-c45b47c60f43 of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] snapshot_file for this snap is: volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc6e06d-761c-45cd-9670-09ad0b4bd22c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:17 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Delete snapshot completed successfully. Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-bee9ebe1-0e97-4438-99f8-a8a5af4e36a9 req-a12b389f-85cf-4c5b-985b-eb7608def820 tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-ad494515-31e9-4864-9313-b8fa9b44fa29-delete_snapshot" released by "delete_snapshot" :: held 3.522s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:17 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 Nov 02 14:28:17 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "cinder-40d680d6-425e-4807-a2f9-5b748cf6db27-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-40d680d6-425e-4807-a2f9-5b748cf6db27-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "cinder-quobyte-40d680d6-425e-4807-a2f9-5b748cf6db27" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-quobyte-40d680d6-425e-4807-a2f9-5b748cf6db27" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[edba10b6-32b5-4f6a-b83b-36cb2b8a2105]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:18 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43" returned: 0 in 0.602s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:18 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 Nov 02 14:28:18 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45d8b3b-4ffa-49c4-8401-cad59e34ba53]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:18 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:18 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:18 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27" returned: 0 in 0.660s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:18 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27 Nov 02 14:28:18 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:18 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.752s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:18 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 Nov 02 14:28:19 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:19 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40d680d6-425e-4807-a2f9-5b748cf6db27" returned: 0 in 0.560s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-quobyte-40d680d6-425e-4807-a2f9-5b748cf6db27" released by "delete_volume" :: held 1.317s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG cinder.quota [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Created reservations ['29066cf4-e497-467f-a7af-dbb4d673e700', '5dae2add-ea5c-4e74-bf0f-0899223df223', 'b6992c8a-1c18-4fa9-8194-06906f854cd4', 'ec4d21e3-f952-47c0-a48e-ba689233fe2a'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:19 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:19 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:19 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43" returned: 0 in 0.823s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:19 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43 Nov 02 14:28:19 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:19 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG cinder.manager [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Deleted volume successfully. Nov 02 14:28:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-16308003-8d1c-4721-986b-c71f5e475066 req-ac319aae-38d0-45bf-8a1b-80a72241977e tempest-VolumesSnapshotsTestJSON-189238304 None] Lock "cinder-40d680d6-425e-4807-a2f9-5b748cf6db27-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:20 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.f44c88c8-ced5-438f-9dc7-c45b47c60f43" returned: 0 in 0.534s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-f44c88c8-ced5-438f-9dc7-c45b47c60f43" released by "_delete_snapshot" :: held 2.901s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" released by "delete_snapshot" :: held 2.940s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:20 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Created reservations ['7aa1b1e6-4d56-495d-96e3-4a97aa7aedaf', 'e7a9e6c0-db24-4663-90e5-5b033c5211b9', 'dcf44b34-2873-44c9-8367-8b68d2fd4642', '4c9b404b-689c-44e7-928a-f21712cf4fca'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:20 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Delete snapshot completed successfully. Nov 02 14:28:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-320ffec6-8dd7-404f-91ef-e4e5f37bab54 tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-f44c88c8-ced5-438f-9dc7-c45b47c60f43-delete_snapshot" released by "delete_snapshot" :: held 3.244s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Creating offline snapshot bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:28:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b446993d-7528-4caa-9f72-cb180b841333]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:21 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:21 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:22 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.526s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:22 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 1G Nov 02 14:28:22 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:22 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 1G" returned: 0 in 0.678s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:22 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 Nov 02 14:28:22 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:23 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" returned: 0 in 0.362s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:23 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 is being set with open permissions: ugo+rw Nov 02 14:28:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:23 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 Nov 02 14:28:23 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:23 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" returned: 0 in 0.356s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8163278d-2d51-4733-a7f4-b632d91730ca tempest-SnapshotsActionsTest-267937541 None] Create snapshot completed successfully Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Acquiring lock "cinder-quobyte-bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Deleting offline snapshot bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] snapshot_file for this snap is: volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d0ce13-ca54-4a48-9cd1-12798052a41b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:25 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 Nov 02 14:28:25 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:25 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" returned: 0 in 0.426s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f2fea0-6990-4248-ac89-b9c3b8e408f5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:25 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:25 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:25 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.496s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:25 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 Nov 02 14:28:25 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:26 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" returned: 0 in 0.531s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:26 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4 Nov 02 14:28:26 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:26 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" returned: 0 in 0.289s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4" released by "_delete_snapshot" :: held 1.880s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" released by "delete_snapshot" :: held 1.968s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:26 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Created reservations ['4bebcc73-ecbf-43d2-ae1f-95120d535361', '2d1e81d2-7f95-4685-ade2-72b4d8a8ef47', 'e5207f90-616c-41ef-8a03-aba97119a941', '33219b4f-fbac-4d0c-a37e-8f67208a432f'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-389b063a-b4a9-42af-9e97-912db75de529 tempest-GroupSnapshotsTest-2059132418 None] Group tempest-GroupSnapshotsTest-Group-999304899: creating Nov 02 14:28:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Delete snapshot completed successfully. Nov 02 14:28:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e0a94519-e791-48ad-9bf8-399cee8f423f tempest-SnapshotsActionsTest-1410194359 None] Lock "cinder-bbc2ab6e-35c6-47ff-bc76-e81ae0402bf4-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-389b063a-b4a9-42af-9e97-912db75de529 tempest-GroupSnapshotsTest-2059132418 None] Group tempest-GroupSnapshotsTest-Group-999304899: created successfully Nov 02 14:28:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-389b063a-b4a9-42af-9e97-912db75de529 tempest-GroupSnapshotsTest-2059132418 None] Create group completed successfully. Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "cinder-4c2bbbf8-c124-4b18-9ee9-67da06bea61d-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-4c2bbbf8-c124-4b18-9ee9-67da06bea61d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "cinder-quobyte-4c2bbbf8-c124-4b18-9ee9-67da06bea61d" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (6ebd3624-3d08-414b-93bf-c9bdb61d7a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f04f1f-2e80-48be-9843-58e1c992abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f04f1f-2e80-48be-9843-58e1c992abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957887747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ffac782-17cc-44d4-8cf6-3d91254efd84,host='devstack@QuobyteHD#QuobyteHD',id=f8247de5-2b9f-4220-8e1e-9a942838527c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:28Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decc3ac4-ca91-4845-b400-e7f521f8b1a8),volume_type_id=decc3ac4-ca91-4845-b400-e7f521f8b1a8)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b36165e-a019-4cab-b237-972a84df8b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b36165e-a019-4cab-b237-972a84df8b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d113c5-7a8f-4dd6-9b49-7cd7fedfe4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d113c5-7a8f-4dd6-9b49-7cd7fedfe4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8247de5-2b9f-4220-8e1e-9a942838527c', 'volume_name': 'volume-f8247de5-2b9f-4220-8e1e-9a942838527c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab46dc5-d783-47a0-8aec-03ae06248209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab46dc5-d783-47a0-8aec-03ae06248209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0c38b0-350d-4489-94c8-e12246e6ac56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:28 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Volume f8247de5-2b9f-4220-8e1e-9a942838527c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8247de5-2b9f-4220-8e1e-9a942838527c', 'volume_size': 1} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2ffac782-17cc-44d4-8cf6-3d91254efd84,created_at=2026-11-02T13:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-957887747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2ffac782-17cc-44d4-8cf6-3d91254efd84,host='devstack@QuobyteHD#QuobyteHD',id=f8247de5-2b9f-4220-8e1e-9a942838527c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:28Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(decc3ac4-ca91-4845-b400-e7f521f8b1a8),volume_type_id=decc3ac4-ca91-4845-b400-e7f521f8b1a8)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Creating volume f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:28 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-quobyte-4c2bbbf8-c124-4b18-9ee9-67da06bea61d" acquired by "_delete_snapshot" :: waited 0.130s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Deleting offline snapshot 4c2bbbf8-c124-4b18-9ee9-67da06bea61d of volume 3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:28 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c 1073741824 Nov 02 14:28:28 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] snapshot_file for this snap is: volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f8538-b945-4edf-983e-d9fb5b867be8]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:28 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:28 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:29 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.397s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dc69277-ff86-45d0-87e3-66572db0001e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:29 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c 1073741824" returned: 0 in 0.500s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bf808a-e8ad-45d4-ba8f-ba44f2cd2926]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:29 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c Nov 02 14:28:29 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:29 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e Nov 02 14:28:29 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:29 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0c38b0-350d-4489-94c8-e12246e6ac56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8247de5-2b9f-4220-8e1e-9a942838527c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121fa545-f31b-44de-b88f-2a825839e6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:29 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Volume volume-f8247de5-2b9f-4220-8e1e-9a942838527c (f8247de5-2b9f-4220-8e1e-9a942838527c): created successfully Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121fa545-f31b-44de-b88f-2a825839e6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (6ebd3624-3d08-414b-93bf-c9bdb61d7a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-862fdf4c-eef4-48e1-b08d-899b5d473c16 tempest-GroupSnapshotsTest-2059132418 None] Created volume successfully. Nov 02 14:28:29 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e" returned: 0 in 0.437s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:29 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:29 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:30 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.417s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:30 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] GroupSnapshot 68f6945c-5f38-424e-89ca-ac729c4e4579: creating. Nov 02 14:28:30 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d Nov 02 14:28:30 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Group snapshot 68f6945c-5f38-424e-89ca-ac729c4e4579: creating. {{(pid=86978) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Creating offline snapshot f8016f08-d919-49d0-92a6-1839166f9aaa of volume f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ed26ec-a915-49c4-aac1-cbf70f70d2ce]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:30 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c Nov 02 14:28:30 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:30 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e.4c2bbbf8-c124-4b18-9ee9-67da06bea61d" returned: 0 in 0.290s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-quobyte-4c2bbbf8-c124-4b18-9ee9-67da06bea61d" released by "_delete_snapshot" :: held 1.685s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" released by "delete_snapshot" :: held 1.826s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Created reservations ['eaf96e15-0513-4627-9adb-a775dafcd419', '6df68c31-c44f-4065-99aa-bbc087d4e5ec', 'ccfe7c7e-f684-4901-af3e-66d63e0bef01', 'fd7aff33-d063-45be-843d-bcb08936bf4f'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Acquiring lock "cinder-d5100f33-10d0-4b93-8624-6ecfef9355e2-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Lock "cinder-d5100f33-10d0-4b93-8624-6ecfef9355e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:30 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Delete snapshot completed successfully. Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-edcdc342-8cfc-44dc-9c19-262097c0a961 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-4c2bbbf8-c124-4b18-9ee9-67da06bea61d-delete_snapshot" released by "delete_snapshot" :: held 2.014s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Acquiring lock "cinder-quobyte-d5100f33-10d0-4b93-8624-6ecfef9355e2" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:30 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Lock "cinder-quobyte-d5100f33-10d0-4b93-8624-6ecfef9355e2" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c" returned: 0 in 0.434s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[412e82d6-a76d-4a83-ae62-8322fbc8e983]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:30 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa 1G Nov 02 14:28:30 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:30 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 Nov 02 14:28:30 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "cinder-3dc69277-ff86-45d0-87e3-66572db0001e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-3dc69277-ff86-45d0-87e3-66572db0001e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b1ca88-9317-43f5-9526-2520f5940498]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2" returned: 0 in 0.392s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e Nov 02 14:28:31 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2 Nov 02 14:28:31 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa 1G" returned: 0 in 0.469s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8247de5-2b9f-4220-8e1e-9a942838527c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8247de5-2b9f-4220-8e1e-9a942838527c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa Nov 02 14:28:31 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d5100f33-10d0-4b93-8624-6ecfef9355e2" returned: 0 in 0.276s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e" returned: 0 in 0.414s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Lock "cinder-quobyte-d5100f33-10d0-4b93-8624-6ecfef9355e2" released by "delete_volume" :: held 0.732s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:31 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e Nov 02 14:28:31 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Created reservations ['e54c8f03-b888-4e73-83fa-646fadfc48a5', 'c08961d4-559a-456a-8e9c-f5d1ad87c5e7', '1d393e77-b0b7-49dd-98fb-c574a10fe308', '00f4af4b-74c5-46ac-881b-2d7efc9bd5d6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:31 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8247de5-2b9f-4220-8e1e-9a942838527c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa" returned: 0 in 0.325s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa Nov 02 14:28:31 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:31 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3dc69277-ff86-45d0-87e3-66572db0001e" returned: 0 in 0.278s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-quobyte-3dc69277-ff86-45d0-87e3-66572db0001e" released by "delete_volume" :: held 0.767s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Created reservations ['2d9b67a6-1890-4c63-ad94-8391cf43e8ab', 'a356e464-2ba5-4f36-b737-15600a789899', '25c69e22-e30f-4819-ab9d-89bde5d82a33', '0cb0fdb9-229a-41b1-a13a-78d12da37779'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:31 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa" returned: 0 in 0.298s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.info Nov 02 14:28:31 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:31 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.334s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Deleted volume successfully. Nov 02 14:28:31 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:31 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-34d719f2-40a3-46ef-929f-8446b6caf1ea tempest-VolumesNegativeTest-1071157322 None] Lock "cinder-d5100f33-10d0-4b93-8624-6ecfef9355e2-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:32 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.info" returned: 0 in 0.307s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:32 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:28:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:32 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.info Nov 02 14:28:32 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:32 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.308s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:32 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Deleted volume successfully. Nov 02 14:28:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-776c0cbe-38b7-4e73-8736-8747a913a161 tempest-SnapshotsActionsTest-267937541 None] Lock "cinder-3dc69277-ff86-45d0-87e3-66572db0001e-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:32 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.info" returned: 0 in 0.293s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d51b8eda-50f8-4ca6-b014-ad167d623812 tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 68f6945c-5f38-424e-89ca-ac729c4e4579: created successfully Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-f8016f08-d919-49d0-92a6-1839166f9aaa-a2d172f0-8195-4409-aeca-773abc89e7cf" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8016f08-d919-49d0-92a6-1839166f9aaa-a2d172f0-8195-4409-aeca-773abc89e7cf" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Creating volume a2d172f0-8195-4409-aeca-773abc89e7cf from snapshot f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-a2d172f0-8195-4409-aeca-773abc89e7cf" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-a2d172f0-8195-4409-aeca-773abc89e7cf" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] snapshot: f8016f08-d919-49d0-92a6-1839166f9aaa, volume: a2d172f0-8195-4409-aeca-773abc89e7cf, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f7feb3-9ddc-4c64-b68a-110e9ca2133b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:35 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa Nov 02 14:28:35 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:35 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa" returned: 0 in 0.599s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8247de5-2b9f-4220-8e1e-9a942838527c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f96bf12-04f0-46c8-afd6-0a59e2f7b83a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:35 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c Nov 02 14:28:35 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:35 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c" returned: 0 in 0.466s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:28:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:35 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf Nov 02 14:28:35 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Flow 'volume_create_manager' (da14c3c2-b02d-4ce5-81df-d2bf7172ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364cf223-a41d-4574-8706-94f7da038efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364cf223-a41d-4574-8706-94f7da038efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-911151004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74414ee5-29b8-42d3-be92-4c5bb50fb60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445c91995bbd4e258c14e20dec1002e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:38Z,use_quota=True,user_id='b2b5467abe8a40058831b92223ef4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea86ace-0ecf-4dd2-afb1-a760755b234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea86ace-0ecf-4dd2-afb1-a760755b234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180575ef-6356-4365-9578-2335d7255821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180575ef-6356-4365-9578-2335d7255821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74414ee5-29b8-42d3-be92-4c5bb50fb60a', 'volume_name': 'volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d2762c-dd92-47d6-89a9-d6323542a91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d2762c-dd92-47d6-89a9-d6323542a91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a7b70-6e2b-492a-9dc1-8a17a6d6293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:38 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Volume 74414ee5-29b8-42d3-be92-4c5bb50fb60a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a', 'volume_size': 1} Nov 02 14:28:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:39 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:39 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:39 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.549s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:28:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Flow 'volume_create_manager' (6e760b4d-b209-4ac9-bd05-9daad9c683f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25249a1e-53ce-4e69-8fb8-781bda25a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25249a1e-53ce-4e69-8fb8-781bda25a842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1750883624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeaf7d6ff364841a9e4839c627152ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:43Z,use_quota=True,user_id='8c9a7dc2265d417491ebc33155b059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0973e268-3cb1-4cde-a6b9-ea58039c7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0973e268-3cb1-4cde-a6b9-ea58039c7d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcc3b9d-726b-4c22-854e-fe89fe85ec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcc3b9d-726b-4c22-854e-fe89fe85ec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2', 'volume_name': 'volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7785a0c-8fa2-47bd-86dc-66123f2c48d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7785a0c-8fa2-47bd-86dc-66123f2c48d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf047bd5-f854-46a9-a433-f61640383ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Volume 02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2', 'volume_size': 1} Nov 02 14:28:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:44 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf" returned: 0 in 8.891s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:44 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:28:44 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Converted 1024.00 MB image at 115.16 MB/s Nov 02 14:28:44 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:28:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:44 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf Nov 02 14:28:44 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:45 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-a2d172f0-8195-4409-aeca-773abc89e7cf" released by "_copy_volume_from_snapshot" :: held 10.367s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8016f08-d919-49d0-92a6-1839166f9aaa-a2d172f0-8195-4409-aeca-773abc89e7cf" released by "_create_volume_from_snapshot" :: held 10.459s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.486s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.755s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-911151004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74414ee5-29b8-42d3-be92-4c5bb50fb60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='445c91995bbd4e258c14e20dec1002e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:38Z,use_quota=True,user_id='b2b5467abe8a40058831b92223ef4d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Creating volume 74414ee5-29b8-42d3-be92-4c5bb50fb60a {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:45 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:45 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a 1073741824 Nov 02 14:28:45 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6e675071-3be5-4d04-9f0d-b9c2e6159288 tempest-GroupSnapshotsTest-2059132418 None] Create group from source-snapshot-68f6945c-5f38-424e-89ca-ac729c4e4579 completed successfully. Nov 02 14:28:45 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a 1073741824" returned: 0 in 0.523s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:45 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a Nov 02 14:28:45 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:46 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a" returned: 0 in 0.367s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.271s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1750883624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeaf7d6ff364841a9e4839c627152ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:43Z,use_quota=True,user_id='8c9a7dc2265d417491ebc33155b059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Creating volume 02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:46 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417a7b70-6e2b-492a-9dc1-8a17a6d6293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:46 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 1073741824 Nov 02 14:28:46 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0156fbd4-8830-4d44-86b5-2274dfff98ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-a2d172f0-8195-4409-aeca-773abc89e7cf" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:46 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Volume volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a (74414ee5-29b8-42d3-be92-4c5bb50fb60a): created successfully Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0156fbd4-8830-4d44-86b5-2274dfff98ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Flow 'volume_create_manager' (da14c3c2-b02d-4ce5-81df-d2bf7172ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-a2d172f0-8195-4409-aeca-773abc89e7cf" acquired by "delete_volume" :: waited 0.043s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-94dc0eb0-4802-4324-bbb5-cf51570d3322 tempest-AttachVolumeShelveTestJSON-1414372403 None] Created volume successfully. Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79179b1-0c7a-4ccb-b2b4-b8a03b96dc36]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:46 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf Nov 02 14:28:46 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:46 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf" returned: 0 in 0.485s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:46 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf Nov 02 14:28:46 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:46 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 1073741824" returned: 0 in 0.718s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:46 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 Nov 02 14:28:46 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:47 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a2d172f0-8195-4409-aeca-773abc89e7cf" returned: 0 in 0.393s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:47 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-a2d172f0-8195-4409-aeca-773abc89e7cf" released by "delete_volume" :: held 0.944s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2" returned: 0 in 0.313s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf047bd5-f854-46a9-a433-f61640383ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506e3e5-26d7-467f-abf6-dbf8be856450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:47 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Volume volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 (02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2): created successfully Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506e3e5-26d7-467f-abf6-dbf8be856450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Flow 'volume_create_manager' (6e760b4d-b209-4ac9-bd05-9daad9c683f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-52b23d42-624a-42cb-b40b-57bf384b5840 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Created volume successfully. Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['44d31c04-c769-49a6-87f1-d5260e0c0302'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:47 devstack cinder-volume[86978]: WARNING cinder.quota [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1751004172 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1751004172, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:28:47 devstack cinder-volume[86978]: WARNING cinder.quota [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1751004172 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1751004172, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['cde9c57a-e71d-4ae9-a78c-7e066d79c754', 'f1ce12c9-b677-41f0-be6e-5828459945f1', '8b82041f-62cc-47f1-a6fe-8d94b836e7ee', '7ae4b1b2-49ef-4ed9-a063-1c7cfea5705b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:47 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:47 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 68f6945c-5f38-424e-89ca-ac729c4e4579: deleting Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 68f6945c-5f38-424e-89ca-ac729c4e4579: deleting {{(pid=86978) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 14:28:47 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.333s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-f8247de5-2b9f-4220-8e1e-9a942838527c" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-675afa79-36ed-4d3b-800a-2e4663ae83c8 tempest-GroupSnapshotsTest-2059132418 None] Delete group completed successfully. Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8247de5-2b9f-4220-8e1e-9a942838527c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-f8016f08-d919-49d0-92a6-1839166f9aaa" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8016f08-d919-49d0-92a6-1839166f9aaa" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Deleting offline snapshot f8016f08-d919-49d0-92a6-1839166f9aaa of volume f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] snapshot_file for this snap is: volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f985cb3c-d52d-4c9c-bb1b-a5d87a55b8c8]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Acquiring lock "cinder-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "cinder-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Acquiring lock "cinder-quobyte-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:48 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa Nov 02 14:28:48 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "cinder-quobyte-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3355cf-0b89-4442-8b7b-4e3c605f1788]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:48 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 Nov 02 14:28:48 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:48 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa" returned: 0 in 0.627s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8247de5-2b9f-4220-8e1e-9a942838527c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7c0a5-2d47-4e8e-ac4a-8b26e1a538fd]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:48 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2" returned: 0 in 0.578s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:48 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c Nov 02 14:28:48 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:48 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2 Nov 02 14:28:48 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:49 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2" returned: 0 in 0.461s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "cinder-quobyte-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2" released by "delete_volume" :: held 1.120s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Created reservations ['478ceef0-0aff-43ac-bea1-4404ffaae3bf', '630b4cea-eb88-45ce-b8b8-31f16acfc0fa', '409a557c-171a-42cd-8192-9a7ab7b4b5fd', '0ab9b7c4-8b44-47b3-8cdc-ce0c93d80ecb'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:49 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c" returned: 0 in 0.925s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:49 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa Nov 02 14:28:49 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:49 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:49 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:50 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa" returned: 0 in 0.581s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:50 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.465s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:50 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa Nov 02 14:28:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Deleted volume successfully. Nov 02 14:28:50 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-816a93a5-e8a9-4baa-8b35-f1b4d00241bb tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "cinder-02dda6bf-a9f2-40f8-9af3-d36cbb8f0cf2-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:50 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c.f8016f08-d919-49d0-92a6-1839166f9aaa" returned: 0 in 0.480s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8016f08-d919-49d0-92a6-1839166f9aaa" released by "_delete_snapshot" :: held 2.790s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8247de5-2b9f-4220-8e1e-9a942838527c" released by "delete_snapshot" :: held 2.843s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:50 devstack cinder-volume[86978]: WARNING cinder.quota [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1751004172 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1751004172, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:28:50 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['4398de81-dd6e-4ec0-89db-7ba1a00f7a50', '571fdc79-cbe7-49d4-a5ef-1d343207bb2b', 'eec79155-799a-49a0-b04f-bc7f8f6972ce', '27f7c9bd-c8a6-423c-b5bc-38b13341b038'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3c217dab-d09e-4b73-ae64-d75a62f5697e tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 68f6945c-5f38-424e-89ca-ac729c4e4579: deleted successfully Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (7632702a-c8d3-4131-8bfa-ca2fde1c77cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f661e5-ff24-47af-bd1d-6af546361a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Flow 'volume_create_manager' (877fa2dc-e18d-4199-89cd-3fda7b237c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18133629-dc29-4c92-a5bd-74e24c70b31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f661e5-ff24-47af-bd1d-6af546361a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1821668805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ae1d85-792f-4982-aca2-c2eff7bc396e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:51Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e48995c-4f3d-4159-b571-f899f982bc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e48995c-4f3d-4159-b571-f899f982bc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e15e7a-551e-4bf7-bd1c-27eb0f9a19a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e15e7a-551e-4bf7-bd1c-27eb0f9a19a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ae1d85-792f-4982-aca2-c2eff7bc396e', 'volume_name': 'volume-80ae1d85-792f-4982-aca2-c2eff7bc396e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0d4926-1baa-4c10-9b0b-bb285b6fa581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0d4926-1baa-4c10-9b0b-bb285b6fa581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4525182a-4dad-42bf-b37f-84211477bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Volume 80ae1d85-792f-4982-aca2-c2eff7bc396e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ae1d85-792f-4982-aca2-c2eff7bc396e', 'volume_size': 1} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1821668805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ae1d85-792f-4982-aca2-c2eff7bc396e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:51Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Creating volume 80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:51 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:51 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e 1073741824 Nov 02 14:28:51 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18133629-dc29-4c92-a5bd-74e24c70b31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-947349974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978fd30c-003a-44f5-8cd1-6b26c66ab39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeaf7d6ff364841a9e4839c627152ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:51Z,use_quota=True,user_id='8c9a7dc2265d417491ebc33155b059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fbf266-8a3c-42a6-b4b3-d57a56f85cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fbf266-8a3c-42a6-b4b3-d57a56f85cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f2cd3e-497f-4758-a7ac-d045d3a272ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f2cd3e-497f-4758-a7ac-d045d3a272ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978fd30c-003a-44f5-8cd1-6b26c66ab39c', 'volume_name': 'volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef77b480-ffee-4cd6-9c2e-31c369c11515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef77b480-ffee-4cd6-9c2e-31c369c11515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b257268-b8f3-44bd-befb-14bc5639c2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Volume 978fd30c-003a-44f5-8cd1-6b26c66ab39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c', 'volume_size': 1} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-f8247de5-2b9f-4220-8e1e-9a942838527c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8247de5-2b9f-4220-8e1e-9a942838527c" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cabf13-6955-4813-af5c-b510c5074741]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:51 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c Nov 02 14:28:51 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:51 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e 1073741824" returned: 0 in 0.500s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:52 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e Nov 02 14:28:52 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:52 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c" returned: 0 in 0.453s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:52 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c Nov 02 14:28:52 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:52 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e" returned: 0 in 0.313s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-947349974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978fd30c-003a-44f5-8cd1-6b26c66ab39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbeaf7d6ff364841a9e4839c627152ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:51Z,use_quota=True,user_id='8c9a7dc2265d417491ebc33155b059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Creating volume 978fd30c-003a-44f5-8cd1-6b26c66ab39c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:52 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4525182a-4dad-42bf-b37f-84211477bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ae1d85-792f-4982-aca2-c2eff7bc396e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:52 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c 1073741824 Nov 02 14:28:52 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69dcd5-895b-4fec-bd90-47b5e0182b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:52 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Volume volume-80ae1d85-792f-4982-aca2-c2eff7bc396e (80ae1d85-792f-4982-aca2-c2eff7bc396e): created successfully Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da69dcd5-895b-4fec-bd90-47b5e0182b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (7632702a-c8d3-4131-8bfa-ca2fde1c77cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e4fae38f-6a85-4d9b-9e4b-5afe10284df3 tempest-VolumesSnapshotTestJSON-158928725 None] Created volume successfully. Nov 02 14:28:52 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8247de5-2b9f-4220-8e1e-9a942838527c" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f8247de5-2b9f-4220-8e1e-9a942838527c" released by "delete_volume" :: held 0.796s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['3eed68e1-c38d-463a-9ddf-8ffc2b362269'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:52 devstack cinder-volume[86978]: WARNING cinder.db.api [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1751004172'] Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['258fd9fd-cf05-49b1-8884-447894e1eb70', '0ae8a067-d5ec-4e7f-87cf-aff7cee9a371', 'b1335da0-cb96-4d13-bc6a-d785f23433e8', 'bbf01c4e-fa87-4330-b41a-33b272935b96'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:52 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:52 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:52 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c 1073741824" returned: 0 in 0.518s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:52 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c Nov 02 14:28:52 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:53 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.340s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-890e92d0-b88f-4aff-b7ed-fc8a0b04b38a tempest-GroupSnapshotsTest-2059132418 None] Delete group completed successfully. Nov 02 14:28:53 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c" returned: 0 in 0.461s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b257268-b8f3-44bd-befb-14bc5639c2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b159c8-ee1b-49a8-ae1c-f5ed1f7e155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:53 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Volume volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c (978fd30c-003a-44f5-8cd1-6b26c66ab39c): created successfully Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b159c8-ee1b-49a8-ae1c-f5ed1f7e155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Flow 'volume_create_manager' (877fa2dc-e18d-4199-89cd-3fda7b237c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cc405268-e95a-4219-ac34-e66cc6f88b82 tempest-VolumeQuotasAdminTestJSON-1872437449 None] Created volume successfully. Nov 02 14:28:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-929b743c-7b7f-4056-95f5-34c6278ffba5 tempest-GroupSnapshotsTest-2059132418 None] Group tempest-GroupSnapshotsTest-Group-1989200812: creating Nov 02 14:28:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-929b743c-7b7f-4056-95f5-34c6278ffba5 tempest-GroupSnapshotsTest-2059132418 None] Group tempest-GroupSnapshotsTest-Group-1989200812: created successfully Nov 02 14:28:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-929b743c-7b7f-4056-95f5-34c6278ffba5 tempest-GroupSnapshotsTest-2059132418 None] Create group completed successfully. Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Creating offline snapshot 45943d18-2ddc-4e38-ba30-820c46a8baae of volume 80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f22a29-79ba-4ba3-ade3-1b5a4bdac298]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:53 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e Nov 02 14:28:53 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:54 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e" returned: 0 in 0.404s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:54 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae 1G Nov 02 14:28:54 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:54 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae 1G" returned: 0 in 0.510s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80ae1d85-792f-4982-aca2-c2eff7bc396e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:54 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80ae1d85-792f-4982-aca2-c2eff7bc396e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae Nov 02 14:28:54 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:55 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80ae1d85-792f-4982-aca2-c2eff7bc396e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae" returned: 0 in 0.460s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:55 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae is being set with open permissions: ugo+rw Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:55 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae Nov 02 14:28:55 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ad106d06-9d45-4ce5-9930-0b16600871a8 tempest-VolumeQuotasAdminTestJSON-1821325633 None] Transfer volume completed successfully. Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:55 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (13933a8e-359b-45d2-a140-9c058eeb22f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96774c3-3598-488c-9577-33cf0cab09b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae" returned: 0 in 0.371s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96774c3-3598-488c-9577-33cf0cab09b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308869533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7536067-d7bd-48aa-b1a6-8c549b8cec13,host='devstack@QuobyteHD#QuobyteHD',id=37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:55Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fcfeec2-1bf2-471a-a045-557ced653a65),volume_type_id=8fcfeec2-1bf2-471a-a045-557ced653a65)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4134feb-ae37-4cd1-a7bc-855f31c068ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4134feb-ae37-4cd1-a7bc-855f31c068ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df4e8ab-4d63-4352-b524-e42b66abdaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df4e8ab-4d63-4352-b524-e42b66abdaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1', 'volume_name': 'volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0839f2f0-5d29-4c25-8323-81aebae48dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0839f2f0-5d29-4c25-8323-81aebae48dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8d52de-8ed3-4dfb-b505-e34ec891d319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:55 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Volume 37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1', 'volume_size': 1} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:55 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.info Nov 02 14:28:55 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:55 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.info" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:55 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.info is being set with open permissions: ugo+rw Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:55 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.info Nov 02 14:28:55 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Acquiring lock "cinder-978fd30c-003a-44f5-8cd1-6b26c66ab39c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Lock "cinder-978fd30c-003a-44f5-8cd1-6b26c66ab39c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Acquiring lock "cinder-quobyte-978fd30c-003a-44f5-8cd1-6b26c66ab39c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Lock "cinder-quobyte-978fd30c-003a-44f5-8cd1-6b26c66ab39c" acquired by "delete_volume" :: waited 0.046s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0dab60-bb6c-4662-8d4e-f64516c0e78b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:56 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c Nov 02 14:28:56 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:56 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.info" returned: 0 in 0.536s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.736s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7536067-d7bd-48aa-b1a6-8c549b8cec13,created_at=2026-11-02T13:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308869533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7536067-d7bd-48aa-b1a6-8c549b8cec13,host='devstack@QuobyteHD#QuobyteHD',id=37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:55Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fcfeec2-1bf2-471a-a045-557ced653a65),volume_type_id=8fcfeec2-1bf2-471a-a045-557ced653a65)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Creating volume 37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:56 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:56 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 1073741824 Nov 02 14:28:56 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:56 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f32faa66-c4f7-4378-9590-58f5a6b5b330 tempest-VolumesSnapshotTestJSON-158928725 None] Create snapshot completed successfully Nov 02 14:28:56 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c" returned: 0 in 0.546s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:56 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c Nov 02 14:28:56 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:56 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 1073741824" returned: 0 in 0.498s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:57 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-978fd30c-003a-44f5-8cd1-6b26c66ab39c" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:57 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 Nov 02 14:28:57 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Lock "cinder-quobyte-978fd30c-003a-44f5-8cd1-6b26c66ab39c" released by "delete_volume" :: held 0.888s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:INSERT=28,cinder:UPDATE=135,cinder:SELECT=134,cinder:DELETE=9 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=128,cinder:INSERT=43,cinder:UPDATE=139,cinder:DELETE=10 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Created reservations ['74a09f63-e228-4ab8-a22f-35602eae70c4', '3de50100-4a82-4cd7-9c77-ea8197c8f9c6', '5498e347-a818-4bd8-9d42-c04cbe7c9e40', '7b3e5707-9654-49f0-8a2a-b197568bd6c3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:57 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:28:57 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:57 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" returned: 0 in 0.283s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8d52de-8ed3-4dfb-b505-e34ec891d319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b095906-ce83-4acf-ae46-975ec809c261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:57 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Volume volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 (37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1): created successfully Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b095906-ce83-4acf-ae46-975ec809c261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (13933a8e-359b-45d2-a140-9c058eeb22f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a7d6918b-4dc1-4efe-8a29-1ad1f61c4a39 tempest-GroupSnapshotsTest-2059132418 None] Created volume successfully. Nov 02 14:28:57 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.255s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:28:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Deleted volume successfully. Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8eda3fc0-e7af-4a8f-9654-54d74e761381 tempest-VolumeQuotasAdminTestJSON-993338813 None] Lock "cinder-978fd30c-003a-44f5-8cd1-6b26c66ab39c-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-45943d18-2ddc-4e38-ba30-820c46a8baae-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-45943d18-2ddc-4e38-ba30-820c46a8baae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-80ae1d85-792f-4982-aca2-c2eff7bc396e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-80ae1d85-792f-4982-aca2-c2eff7bc396e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-45943d18-2ddc-4e38-ba30-820c46a8baae" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-45943d18-2ddc-4e38-ba30-820c46a8baae" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Deleting offline snapshot 45943d18-2ddc-4e38-ba30-820c46a8baae of volume 80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] snapshot_file for this snap is: volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c028a3e9-0442-477a-b8e6-687a743ea96e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:57 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae Nov 02 14:28:57 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:58 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae" returned: 0 in 0.477s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80ae1d85-792f-4982-aca2-c2eff7bc396e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0ffd45-6591-4d57-a230-6d5fffe81a53]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:58 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e Nov 02 14:28:58 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (b65d517a-b661-464a-af78-da2ff225f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b55af07-e487-494a-a3d1-a1d5768b64e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b55af07-e487-494a-a3d1-a1d5768b64e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271100775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7536067-d7bd-48aa-b1a6-8c549b8cec13,host='devstack@QuobyteHD#QuobyteHD',id=3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:59Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fcfeec2-1bf2-471a-a045-557ced653a65),volume_type_id=8fcfeec2-1bf2-471a-a045-557ced653a65)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3231fa2d-340e-49ae-be23-b0c72c904c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3231fa2d-340e-49ae-be23-b0c72c904c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807e22cb-8657-4510-8768-80317b7ccebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807e22cb-8657-4510-8768-80317b7ccebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8', 'volume_name': 'volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8270592-4315-4fd7-b7e8-d67aafc36080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8270592-4315-4fd7-b7e8-d67aafc36080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8cca07-88a0-4ddf-b68e-76494d1d2eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:58 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Volume 3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8', 'volume_size': 1} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7536067-d7bd-48aa-b1a6-8c549b8cec13,created_at=2026-11-02T13:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271100775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7536067-d7bd-48aa-b1a6-8c549b8cec13,host='devstack@QuobyteHD#QuobyteHD',id=3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:28:59Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fcfeec2-1bf2-471a-a045-557ced653a65),volume_type_id=8fcfeec2-1bf2-471a-a045-557ced653a65)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Creating volume 3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:28:58 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:58 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 1073741824 Nov 02 14:28:58 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-3392848a-2050-4448-90ec-2a24d154d385 req-bd2bb936-906e-4ab4-8d0f-8c56c36c3bf9 tempest-AttachVolumeShelveTestJSON-1414372403 None] No connector for attachment fced1cd4-1ce5-4a6e-ab1e-3a99a4685380; skipping storage backend terminate_connection call. {{(pid=86978) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-3392848a-2050-4448-90ec-2a24d154d385 req-bd2bb936-906e-4ab4-8d0f-8c56c36c3bf9 tempest-AttachVolumeShelveTestJSON-1414372403 None] Deleting attachment fced1cd4-1ce5-4a6e-ab1e-3a99a4685380. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:28:58 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e" returned: 0 in 0.513s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:58 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae Nov 02 14:28:58 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:59 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:59 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 1073741824" returned: 0 in 0.582s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae" returned: 0 in 0.504s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:59 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae Nov 02 14:28:59 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:28:59 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 Nov 02 14:28:59 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:28:59 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e.45943d18-2ddc-4e38-ba30-820c46a8baae" returned: 0 in 0.472s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:59 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" returned: 0 in 0.412s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-45943d18-2ddc-4e38-ba30-820c46a8baae" released by "_delete_snapshot" :: held 2.169s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8cca07-88a0-4ddf-b68e-76494d1d2eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b0449a-f7ae-4a41-90cf-3bb40b367684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-80ae1d85-792f-4982-aca2-c2eff7bc396e" released by "delete_snapshot" :: held 2.238s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:28:59 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Volume volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 (3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8): created successfully Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b0449a-f7ae-4a41-90cf-3bb40b367684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:28:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (b65d517a-b661-464a-af78-da2ff225f204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7778370c-4498-420e-9fa8-66b654494970 tempest-GroupSnapshotsTest-2059132418 None] Created volume successfully. Nov 02 14:29:00 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['03317e75-ae8f-4084-b736-49b6309c6da1', '0cbc5363-8479-4119-994e-fd3d55f86c33', '979eed19-e01a-40a8-9b39-85e867c4ea52', 'd0812532-9507-4418-bb00-d4c6365c3f47'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Delete snapshot completed successfully. Nov 02 14:29:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bbf7220-8880-4281-8df8-f24c88a394c5 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-45943d18-2ddc-4e38-ba30-820c46a8baae-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:01 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4a3c66a8-534d-4b90-b328-fb49e2748286 tempest-GroupSnapshotsTest-2059132418 None] Update group completed successfully. Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (c89a8ebe-1800-40f5-89a7-0a42cd5e5854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df887373-a477-4449-9136-403ef98abd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df887373-a477-4449-9136-403ef98abd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-356103504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3649c0f1-bfe1-4ee7-928c-8ac60b6869dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:02Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc843287-94c4-4495-9fb6-17107c78839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc843287-94c4-4495-9fb6-17107c78839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bddb95e-f3ff-49f1-886b-9c9256a5589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bddb95e-f3ff-49f1-886b-9c9256a5589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3649c0f1-bfe1-4ee7-928c-8ac60b6869dd', 'volume_name': 'volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9c51ec-a78f-4573-b942-9f06dbb5879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9c51ec-a78f-4573-b942-9f06dbb5879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81b24a9-8817-41cf-aa84-d70514b22c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:01 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Volume 3649c0f1-bfe1-4ee7-928c-8ac60b6869dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd', 'volume_size': 1} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-356103504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3649c0f1-bfe1-4ee7-928c-8ac60b6869dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:02Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Creating volume 3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:01 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:29:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:01 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd 1073741824 Nov 02 14:29:01 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:02 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd 1073741824" returned: 0 in 0.568s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:02 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd Nov 02 14:29:02 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3b7edca0-e137-4f32-b252-56c4d86622ef tempest-GroupSnapshotsTest-2059132418 None] Update group completed successfully. Nov 02 14:29:02 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" returned: 0 in 0.363s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81b24a9-8817-41cf-aa84-d70514b22c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d969309b-2453-4827-b817-306d01ae79de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:02 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Volume volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd (3649c0f1-bfe1-4ee7-928c-8ac60b6869dd): created successfully Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d969309b-2453-4827-b817-306d01ae79de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (c89a8ebe-1800-40f5-89a7-0a42cd5e5854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-39d3009d-37a3-4549-8586-f8d48cca73f0 tempest-VolumesSnapshotTestJSON-158928725 None] Created volume successfully. Nov 02 14:29:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4ad88c7c-9549-47ef-ad11-03fba0b9c962 tempest-GroupSnapshotsTest-2059132418 None] Update group completed successfully. Nov 02 14:29:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Creating offline snapshot 549416ef-ef0a-408a-b1c4-07dafc6ba5b5 of volume 3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:29:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e32f1-0a5f-471a-a8fb-865987e6170c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:04 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd Nov 02 14:29:04 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:04 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" returned: 0 in 0.494s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:04 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 1G Nov 02 14:29:04 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:05 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 1G" returned: 0 in 0.629s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:05 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 Nov 02 14:29:05 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7a15dd5e-886b-4a68-807e-886214ac85d8 tempest-GroupSnapshotsTest-2059132418 None] Update group completed successfully. Nov 02 14:29:05 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:05 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:05 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 is being set with open permissions: ugo+rw Nov 02 14:29:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:05 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 Nov 02 14:29:05 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:05 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:05 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.info Nov 02 14:29:05 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:06 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.info" returned: 0 in 0.289s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:06 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.info is being set with open permissions: ugo+rw Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:06 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.info Nov 02 14:29:06 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:06 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.info" returned: 0 in 0.338s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-fc69310b-7df0-4ff8-a7d3-217855be2d54 tempest-VolumesSnapshotTestJSON-158928725 None] Create snapshot completed successfully Nov 02 14:29:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] GroupSnapshot 4af00d55-8b2b-4ca7-bf3f-efdb4f5c5571: creating. Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Group snapshot 4af00d55-8b2b-4ca7-bf3f-efdb4f5c5571: creating. {{(pid=86978) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Creating offline snapshot 1258dc1d-452a-4aaf-8f98-39436332eb82 of volume 3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec2a122-4ada-40b4-88f6-1170c4c8a0bc]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:06 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 Nov 02 14:29:06 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:07 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" returned: 0 in 0.491s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:07 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 1G Nov 02 14:29:07 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Flow 'volume_create_manager' (8f7a13ab-d021-4388-bae4-b597d53db404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdd9d2e-9521-465a-8809-3b130fafdc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdd9d2e-9521-465a-8809-3b130fafdc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-740925175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0be8ff-8469-4e49-abb5-ad48260a7d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f100e7cd5c24993adcee05ab5696451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:07Z,use_quota=True,user_id='7475e6683fbf49769a0bdcac48b66727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5078c50d-7558-4f1c-8cce-b170b4774f10),volume_type_id=5078c50d-7558-4f1c-8cce-b170b4774f10)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54776830-78b0-47a5-9f83-6abfe77730bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54776830-78b0-47a5-9f83-6abfe77730bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0950f68c-cc47-4d56-a303-026cdd071467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0950f68c-cc47-4d56-a303-026cdd071467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0be8ff-8469-4e49-abb5-ad48260a7d49', 'volume_name': 'volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558ff5e3-2269-472d-b05e-97cdd9b23a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558ff5e3-2269-472d-b05e-97cdd9b23a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e55dce8-465b-4af5-9f78-4bf3dd652a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Volume 2a0be8ff-8469-4e49-abb5-ad48260a7d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49', 'volume_size': 1} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:07 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 1G" returned: 0 in 0.588s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:07 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 Nov 02 14:29:07 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (019da8bc-1053-42c3-aaff-e444f97b3c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bff362-c4a5-461e-9601-1545733ca889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bff362-c4a5-461e-9601-1545733ca889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-793448751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e80422c-5c4d-4cd3-936a-07a7056f2c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=549416ef-ef0a-408a-b1c4-07dafc6ba5b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:08Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafd803d-add7-4097-bf4a-80c9cd4d1bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafd803d-add7-4097-bf4a-80c9cd4d1bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670058db-bd70-4a97-8e9b-e82dab5eff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670058db-bd70-4a97-8e9b-e82dab5eff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e80422c-5c4d-4cd3-936a-07a7056f2c5f', 'volume_name': 'volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f', 'volume_size': 2, 'snapshot_id': '549416ef-ef0a-408a-b1c4-07dafc6ba5b5'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c4f259-3e68-43f2-aae6-013db58c9cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c4f259-3e68-43f2-aae6-013db58c9cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd7dd89-d611-4097-92c8-40ef2f351b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:07 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Volume 2e80422c-5c4d-4cd3-936a-07a7056f2c5f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f', 'volume_size': 2, 'snapshot_id': '549416ef-ef0a-408a-b1c4-07dafc6ba5b5'} Nov 02 14:29:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:08 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82" returned: 0 in 0.307s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:08 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:08 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 Nov 02 14:29:08 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:08 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82" returned: 0 in 0.254s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:08 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.info Nov 02 14:29:08 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:08 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.info" returned: 0 in 0.262s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:08 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:08 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.info Nov 02 14:29:08 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:08 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.info" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Creating offline snapshot af0a1811-c199-4c7a-a9a8-4fb765f7e08b of volume 37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:29:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd1010-2b9d-4e68-96c9-67967d544683]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:09 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 Nov 02 14:29:09 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:09 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" returned: 0 in 0.586s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:09 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b 1G Nov 02 14:29:09 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:10 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b 1G" returned: 0 in 0.592s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:10 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b Nov 02 14:29:10 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:10 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b" returned: 0 in 0.314s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:10 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:10 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b Nov 02 14:29:10 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:10 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b" returned: 0 in 0.283s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:10 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.info Nov 02 14:29:10 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:11 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.info" returned: 0 in 0.292s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:11 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:11 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.info Nov 02 14:29:11 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:11 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.info" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.428s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-549416ef-ef0a-408a-b1c4-07dafc6ba5b5-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-549416ef-ef0a-408a-b1c4-07dafc6ba5b5-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Creating volume 2e80422c-5c4d-4cd3-936a-07a7056f2c5f from snapshot 549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] snapshot: 549416ef-ef0a-408a-b1c4-07dafc6ba5b5, volume: 2e80422c-5c4d-4cd3-936a-07a7056f2c5f, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae420e5-80cf-4aa3-98c5-7efce77d0da4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:11 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-29b57af9-d844-4f4e-a5e5-b389df3a0a91 tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 4af00d55-8b2b-4ca7-bf3f-efdb4f5c5571: created successfully Nov 02 14:29:11 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 Nov 02 14:29:11 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:11 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5" returned: 0 in 0.398s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8e1c3b-727e-40a8-af02-46c9ba3929cc]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:12 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd Nov 02 14:29:12 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:12 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 4af00d55-8b2b-4ca7-bf3f-efdb4f5c5571: deleting Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 4af00d55-8b2b-4ca7-bf3f-efdb4f5c5571: deleting {{(pid=86978) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-1258dc1d-452a-4aaf-8f98-39436332eb82" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-1258dc1d-452a-4aaf-8f98-39436332eb82" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Deleting offline snapshot 1258dc1d-452a-4aaf-8f98-39436332eb82 of volume 3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] snapshot_file for this snap is: volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d84d3e-5331-426b-a407-0abfa57f4683]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:12 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" returned: 0 in 0.501s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:12 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 Nov 02 14:29:12 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:12 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f Nov 02 14:29:12 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:12 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82" returned: 0 in 0.454s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6af1cb2-d418-4aff-bc7d-3d54f250a0e6]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:13 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 Nov 02 14:29:13 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:13 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" returned: 0 in 0.677s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:13 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 Nov 02 14:29:13 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:14 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82" returned: 0 in 0.731s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:14 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82 Nov 02 14:29:14 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:14 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8.1258dc1d-452a-4aaf-8f98-39436332eb82" returned: 0 in 0.419s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-1258dc1d-452a-4aaf-8f98-39436332eb82" released by "_delete_snapshot" :: held 2.502s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" released by "delete_snapshot" :: held 2.544s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-af0a1811-c199-4c7a-a9a8-4fb765f7e08b" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-af0a1811-c199-4c7a-a9a8-4fb765f7e08b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Deleting offline snapshot af0a1811-c199-4c7a-a9a8-4fb765f7e08b of volume 37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:29:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] snapshot_file for this snap is: volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:29:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[60459194-2046-4003-805a-e9ca5e67d458]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:15 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b Nov 02 14:29:15 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:15 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b" returned: 0 in 0.707s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b91b11b-74b2-4d7b-acaf-789debb50ea4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:16 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 Nov 02 14:29:16 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:16 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" returned: 0 in 0.724s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:16 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b Nov 02 14:29:16 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b" returned: 0 in 0.680s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:17 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:17 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b Nov 02 14:29:17 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:17 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1.af0a1811-c199-4c7a-a9a8-4fb765f7e08b" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-af0a1811-c199-4c7a-a9a8-4fb765f7e08b" released by "_delete_snapshot" :: held 2.785s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" released by "delete_snapshot" :: held 2.830s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:17 devstack cinder-volume[86978]: WARNING cinder.quota [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1443876397 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1443876397, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:17 devstack cinder-volume[86978]: WARNING cinder.quota [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1443876397 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1443876397, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:18 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['0b8be2fe-8095-4dda-bf64-2d31eb2fba87', 'fa49fc27-aa21-458b-a741-5194afabdcc5', '3859713c-096a-494a-a7ce-837a0d8d60e4', 'fab1dd0a-d952-4599-8947-0487f0805594'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:18 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['3f33c848-3d5a-40ca-9a61-061eaa1f58c9', '120b91b4-0d07-4012-a581-d671edc141b6', 'e9e999c0-ce66-48c4-8765-5220b577442d', '445a60b4-2a72-4c84-a223-18857954a9fd'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-76af16fb-65a9-4ecc-b8a6-e884d9f77bbd tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 4af00d55-8b2b-4ca7-bf3f-efdb4f5c5571: deleted successfully Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[449bc906-fb3e-4f37-b41f-95ac55faaa37]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:20 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 Nov 02 14:29:20 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:20 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" returned: 0 in 8.109s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd, size 1024.00 MB, duration 8.11 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:29:20 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Converted 1024.00 MB image at 126.24 MB/s Nov 02 14:29:20 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f is being set with open permissions: ugo+rw Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:20 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f Nov 02 14:29:20 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:20 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" returned: 0 in 0.520s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:20 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8 Nov 02 14:29:20 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:20 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" released by "_copy_volume_from_snapshot" :: held 9.449s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-549416ef-ef0a-408a-b1c4-07dafc6ba5b5-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" released by "_create_volume_from_snapshot" :: held 9.542s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.577s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.374s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-740925175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0be8ff-8469-4e49-abb5-ad48260a7d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f100e7cd5c24993adcee05ab5696451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:07Z,use_quota=True,user_id='7475e6683fbf49769a0bdcac48b66727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5078c50d-7558-4f1c-8cce-b170b4774f10),volume_type_id=5078c50d-7558-4f1c-8cce-b170b4774f10)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Creating volume 2a0be8ff-8469-4e49-abb5-ad48260a7d49 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:21 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:21 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 1073741824 Nov 02 14:29:21 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd7dd89-d611-4097-92c8-40ef2f351b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f', 'volume_size': 2, 'snapshot_id': '549416ef-ef0a-408a-b1c4-07dafc6ba5b5'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fca9c25-8470-4927-a21e-982b8f000330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:21 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Volume volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f (2e80422c-5c4d-4cd3-936a-07a7056f2c5f): created successfully Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fca9c25-8470-4927-a21e-982b8f000330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (019da8bc-1053-42c3-aaff-e444f97b3c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:21 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-3519ac2d-d465-4ed0-a6f7-c7ed7aa2e6e8" released by "delete_volume" :: held 0.964s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d9d5ce6c-46cd-4e74-8b62-356edb26652c tempest-VolumesSnapshotTestJSON-158928725 None] Created volume successfully. Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" acquired by "delete_volume" :: waited 0.034s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b1a7e1-cab6-49bc-8e9f-2510d7b87577]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-2e80422c-5c4d-4cd3-936a-07a7056f2c5f-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:21 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-2e80422c-5c4d-4cd3-936a-07a7056f2c5f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:21 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f62e3-43f4-49d1-9082-1f2895da45aa]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:21 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 1073741824" returned: 0 in 0.697s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:21 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f Nov 02 14:29:21 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:21 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 Nov 02 14:29:21 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:21 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" returned: 0 in 0.671s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:21 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1 Nov 02 14:29:21 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:22 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49" returned: 0 in 0.302s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:22 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e55dce8-465b-4af5-9f78-4bf3dd652a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a141312-57d8-4c2a-ba99-ff577cbce8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" returned: 0 in 0.552s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Volume volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 (2a0be8ff-8469-4e49-abb5-ad48260a7d49): created successfully Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a141312-57d8-4c2a-ba99-ff577cbce8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:22 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Flow 'volume_create_manager' (8f7a13ab-d021-4388-bae4-b597d53db404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:22 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4e459c25-7385-4e6e-bb33-16c9c493e8e2 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Created volume successfully. Nov 02 14:29:22 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" returned: 0 in 0.330s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-37a2fe6b-a2f9-4dbf-89c7-01e24523e7e1" released by "delete_volume" :: held 1.072s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['9555c0b2-e799-4403-9e89-a87ab44fb2f3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:22 devstack cinder-volume[86978]: WARNING cinder.quota [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1443876397 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1443876397, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:22 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" returned: 0 in 0.276s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-2e80422c-5c4d-4cd3-936a-07a7056f2c5f" released by "delete_volume" :: held 0.896s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['6bcbb556-76ef-4692-994d-5b3ecbc1dd98', '689e4831-0174-4b28-bf14-b4ed79b51439', '6ff12cbc-f106-4076-b4d2-9553bf3adf7d', '5757436f-b2ca-41b0-9945-f5c2521833e4'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['f62da939-e4af-4083-90d4-2b8f0fb08a5f', '1306562f-bafe-4d83-830c-e17a1e3961e4', '9ded042c-4d76-4e0d-a4b0-d8b138dce0ef', '7e0387ce-8637-4623-be90-8ecb3a2b7b28'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['b9695f4d-94f7-40d3-a891-62a1515f5ded', '6f52e4af-bdae-4155-b77f-bab00f6663e7', '672c7038-bfff-4342-9515-ded98a9fe0d6', 'fa70dd6f-d77b-41cc-bd23-00ec263f7971'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:22 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:22 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-549416ef-ef0a-408a-b1c4-07dafc6ba5b5-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-549416ef-ef0a-408a-b1c4-07dafc6ba5b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:22 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:22 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-549416ef-ef0a-408a-b1c4-07dafc6ba5b5" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-549416ef-ef0a-408a-b1c4-07dafc6ba5b5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Deleting offline snapshot 549416ef-ef0a-408a-b1c4-07dafc6ba5b5 of volume 3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] snapshot_file for this snap is: volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[812e7aee-e742-4d89-85a8-c1d23a53328d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:23 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 Nov 02 14:29:23 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:23 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.663s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Deleted volume successfully. Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a2fc222b-9ce3-4697-a599-c648dc353654 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-2e80422c-5c4d-4cd3-936a-07a7056f2c5f-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:23 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.624s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d7dc2b15-af24-4f3d-a7d6-8294def33d66 tempest-GroupSnapshotsTest-2059132418 None] Delete group completed successfully. Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:23 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-51bd52bc-8540-4944-87f9-6fbab04a458e tempest-GroupSnapshotsTest-2059132418 None] Group tempest-GroupSnapshotsTest-Group-1931903746: creating Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5" returned: 0 in 0.887s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:23 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:23 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea9d3a6-56df-4568-8db2-d846e124d281]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-51bd52bc-8540-4944-87f9-6fbab04a458e tempest-GroupSnapshotsTest-2059132418 None] Group tempest-GroupSnapshotsTest-Group-1931903746: created successfully Nov 02 14:29:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-51bd52bc-8540-4944-87f9-6fbab04a458e tempest-GroupSnapshotsTest-2059132418 None] Create group completed successfully. Nov 02 14:29:24 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd Nov 02 14:29:24 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:24 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.393s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:24 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:24 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4943e5b6-a2df-4fe2-a679-5be08ccf9f73 tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Retype volume completed successfully. Nov 02 14:29:24 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" returned: 0 in 0.606s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:24 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 Nov 02 14:29:24 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:24 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5" returned: 0 in 0.478s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:25 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5 Nov 02 14:29:25 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Acquiring lock "cinder-2a0be8ff-8469-4e49-abb5-ad48260a7d49-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "cinder-2a0be8ff-8469-4e49-abb5-ad48260a7d49-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Acquiring lock "cinder-quobyte-2a0be8ff-8469-4e49-abb5-ad48260a7d49" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "cinder-quobyte-2a0be8ff-8469-4e49-abb5-ad48260a7d49" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[705032b9-c650-412e-91ec-6ead47b3d6a4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:25 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 Nov 02 14:29:25 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:25 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd.549416ef-ef0a-408a-b1c4-07dafc6ba5b5" returned: 0 in 0.323s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-549416ef-ef0a-408a-b1c4-07dafc6ba5b5" released by "_delete_snapshot" :: held 2.489s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" released by "delete_snapshot" :: held 2.541s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['6afeeb2b-50f1-4c3c-9a2a-29f1bcb17bcf', '84984fe3-e2b1-4bd2-a9cb-e1ec3cdf486d', '2b417e38-6f5a-4d0a-acd9-913fa876f552', 'ac455861-0e2f-4f1c-8bc7-a5c1417ba06a'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (415ff627-5510-4692-b340-1e6e3009ff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b4924d-1299-41b8-84ff-4b3dfcae8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b4924d-1299-41b8-84ff-4b3dfcae8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-588050226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ca61eb1-84eb-48e8-95ad-fb0202341b0b,host='devstack@QuobyteHD#QuobyteHD',id=51d35497-e228-43e5-9722-19a8f05b2798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:25Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cf899b-a0a3-44f2-968a-ca26b26c242d),volume_type_id=d6cf899b-a0a3-44f2-968a-ca26b26c242d)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c450262-83af-41d2-9785-c157fa4c4952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c450262-83af-41d2-9785-c157fa4c4952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ef9226-a438-44f9-94c8-3960d394a206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:25 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ef9226-a438-44f9-94c8-3960d394a206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d35497-e228-43e5-9722-19a8f05b2798', 'volume_name': 'volume-51d35497-e228-43e5-9722-19a8f05b2798', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947191f5-c36f-42ee-9ef7-3b2d5123adf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947191f5-c36f-42ee-9ef7-3b2d5123adf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ffc2cd-84ed-4e8d-8dd9-505222cb9d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:25 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Volume 51d35497-e228-43e5-9722-19a8f05b2798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d35497-e228-43e5-9722-19a8f05b2798', 'volume_size': 1} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ca61eb1-84eb-48e8-95ad-fb0202341b0b,created_at=2026-11-02T13:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-588050226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ca61eb1-84eb-48e8-95ad-fb0202341b0b,host='devstack@QuobyteHD#QuobyteHD',id=51d35497-e228-43e5-9722-19a8f05b2798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84f17bedad447938d6d06a2561e9d43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:25Z,use_quota=True,user_id='920576a94acd4da0aed5560ae0326c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cf899b-a0a3-44f2-968a-ca26b26c242d),volume_type_id=d6cf899b-a0a3-44f2-968a-ca26b26c242d)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Creating volume 51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:25 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49" returned: 0 in 0.489s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:25 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 1073741824 Nov 02 14:29:25 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:25 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49 Nov 02 14:29:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Delete snapshot completed successfully. Nov 02 14:29:25 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba849bfd-565c-40da-ad21-6f33ca57a3ab tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-549416ef-ef0a-408a-b1c4-07dafc6ba5b5-delete_snapshot" released by "delete_snapshot" :: held 2.869s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:25 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2a0be8ff-8469-4e49-abb5-ad48260a7d49" returned: 0 in 0.294s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "cinder-quobyte-2a0be8ff-8469-4e49-abb5-ad48260a7d49" released by "delete_volume" :: held 0.831s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:25 devstack cinder-volume[86978]: WARNING cinder.quota [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:25 devstack cinder-volume[86978]: WARNING cinder.quota [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Created reservations ['8db3e843-cd90-4db1-aeb7-94e3beb67f50', 'c8917470-6dba-4425-8c1a-d13731f70483', 'c9f68837-d990-47af-8597-67a26d1869eb', '0fc0e941-1167-4a36-95e3-7572e6a26253'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:26 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:26 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:26 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 1073741824" returned: 0 in 0.533s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:26 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 Nov 02 14:29:26 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6c46f-07fa-49cb-a965-ba7ecae29002]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:26 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Deleted volume successfully. Nov 02 14:29:26 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd Nov 02 14:29:26 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-141fdb60-3843-4b82-a80f-d0054e1db86b tempest-VolumeRetypeWithoutMigrationTest-1919210321 None] Lock "cinder-2a0be8ff-8469-4e49-abb5-ad48260a7d49-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:26 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798" returned: 0 in 0.319s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ffc2cd-84ed-4e8d-8dd9-505222cb9d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d35497-e228-43e5-9722-19a8f05b2798', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df6986a-7147-4601-ac6a-8c0d38db57f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:26 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Volume volume-51d35497-e228-43e5-9722-19a8f05b2798 (51d35497-e228-43e5-9722-19a8f05b2798): created successfully Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df6986a-7147-4601-ac6a-8c0d38db57f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Flow 'volume_create_manager' (415ff627-5510-4692-b340-1e6e3009ff69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5a4bf8ce-abf6-42ba-9a11-59fd0ea4f4bc tempest-GroupSnapshotsTest-2059132418 None] Created volume successfully. Nov 02 14:29:26 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" returned: 0 in 0.496s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:26 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd Nov 02 14:29:26 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] GroupSnapshot 1e50cff7-7b19-4695-b3a8-6be1a56abc6b: creating. Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Group snapshot 1e50cff7-7b19-4695-b3a8-6be1a56abc6b: creating. {{(pid=86978) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Creating offline snapshot f840dbe8-4980-4273-9896-4f000cac0182 of volume 51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3414adc3-8628-4b24-a162-bd155e51d49d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:27 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" returned: 0 in 0.329s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd" released by "delete_volume" :: held 0.917s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:27 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 Nov 02 14:29:27 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['afe19039-62ee-4cf4-930e-142e16e17aae', '0219dfea-7534-4c76-888f-249a25b54044', 'a7a3d214-3c33-46d6-aa2e-505b578fbea1', 'b344cffd-679e-4460-9d38-07324907bb32'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:27 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:27 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:27 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798" returned: 0 in 0.392s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:27 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 1G Nov 02 14:29:27 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:27 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.292s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:27 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Deleted volume successfully. Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8b2b43c-58aa-4adb-a81c-39cb38fcb32f tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-3649c0f1-bfe1-4ee7-928c-8ac60b6869dd-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:27 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 1G" returned: 0 in 0.469s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d35497-e228-43e5-9722-19a8f05b2798 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:27 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d35497-e228-43e5-9722-19a8f05b2798 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 Nov 02 14:29:27 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:28 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51d35497-e228-43e5-9722-19a8f05b2798 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182" returned: 0 in 0.308s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:28 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:28 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 Nov 02 14:29:28 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:28 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182" returned: 0 in 0.301s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:28 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.info Nov 02 14:29:28 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:28 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.info" returned: 0 in 0.307s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:28 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:28 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.info Nov 02 14:29:28 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (5612ce03-442b-4ca4-9810-48eb21fc743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc59be4b-acad-47c6-bfc5-945526a395f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc59be4b-acad-47c6-bfc5-945526a395f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1747489865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c969cf74-c7bb-4b61-a020-8232b6543805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:29Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4523e8-687a-4a3c-9079-17d1581c6125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4523e8-687a-4a3c-9079-17d1581c6125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b3e263-063a-43c3-b108-f900f4e91bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b3e263-063a-43c3-b108-f900f4e91bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c969cf74-c7bb-4b61-a020-8232b6543805', 'volume_name': 'volume-c969cf74-c7bb-4b61-a020-8232b6543805', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ab8079-5e86-4d1c-820f-93b80e36b580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ab8079-5e86-4d1c-820f-93b80e36b580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2012b5b2-10c4-4936-a204-be2b123342d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:29 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Volume c969cf74-c7bb-4b61-a020-8232b6543805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c969cf74-c7bb-4b61-a020-8232b6543805', 'volume_size': 1} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:29 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.info" returned: 0 in 0.340s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1747489865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c969cf74-c7bb-4b61-a020-8232b6543805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:29Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Creating volume c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:29 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:29 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 1073741824 Nov 02 14:29:29 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a82205bc-3328-402e-b35c-0674015e64f0 tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 1e50cff7-7b19-4695-b3a8-6be1a56abc6b: created successfully Nov 02 14:29:29 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 1073741824" returned: 0 in 0.470s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:29 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 Nov 02 14:29:29 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:29 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2012b5b2-10c4-4936-a204-be2b123342d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c969cf74-c7bb-4b61-a020-8232b6543805', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa82923-e9d5-4b5f-95b7-b800eda304fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:30 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Volume volume-c969cf74-c7bb-4b61-a020-8232b6543805 (c969cf74-c7bb-4b61-a020-8232b6543805): created successfully Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa82923-e9d5-4b5f-95b7-b800eda304fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (5612ce03-442b-4ca4-9810-48eb21fc743c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:30 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4e0525a5-f7d7-4291-83a6-2a6db0288d10 tempest-VolumesSnapshotTestJSON-158928725 None] Created volume successfully. Nov 02 14:29:30 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 1e50cff7-7b19-4695-b3a8-6be1a56abc6b: deleting Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 1e50cff7-7b19-4695-b3a8-6be1a56abc6b: deleting {{(pid=86978) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-51d35497-e228-43e5-9722-19a8f05b2798" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-51d35497-e228-43e5-9722-19a8f05b2798" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-f840dbe8-4980-4273-9896-4f000cac0182" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f840dbe8-4980-4273-9896-4f000cac0182" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Deleting offline snapshot f840dbe8-4980-4273-9896-4f000cac0182 of volume 51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] snapshot_file for this snap is: volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbd8f0-802a-4fbd-bdfc-1466f70cfe97]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:30 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 Nov 02 14:29:30 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:30 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51d35497-e228-43e5-9722-19a8f05b2798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace11eaf-93cc-48d5-bfeb-2a9f7c3217a1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:31 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 Nov 02 14:29:31 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Creating offline snapshot d83f14fd-26dc-4c08-b56c-49d97481284f of volume c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6794168-22e2-46a7-be4b-57a2881e23e1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:31 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 Nov 02 14:29:31 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:31 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798" returned: 0 in 0.427s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:31 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 Nov 02 14:29:31 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:31 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805" returned: 0 in 0.437s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:31 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f 1G Nov 02 14:29:31 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:31 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182" returned: 0 in 0.456s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:31 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182 Nov 02 14:29:31 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:32 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798.f840dbe8-4980-4273-9896-4f000cac0182" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-f840dbe8-4980-4273-9896-4f000cac0182" released by "_delete_snapshot" :: held 1.769s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-51d35497-e228-43e5-9722-19a8f05b2798" released by "delete_snapshot" :: held 1.796s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:32 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f 1G" returned: 0 in 0.569s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c969cf74-c7bb-4b61-a020-8232b6543805 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:32 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c969cf74-c7bb-4b61-a020-8232b6543805 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f Nov 02 14:29:32 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:32 devstack cinder-volume[86978]: WARNING cinder.quota [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1827473854 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1827473854, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:32 devstack cinder-volume[86978]: WARNING cinder.quota [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1827473854 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1827473854, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['bd7b46b8-b930-4d1d-a21a-95ee0fd05207', '3f3bdeb7-d511-4260-8226-4ba302119935', 'bc301afc-0b9f-4eda-ad7b-5a5d65a55874', '8b0be43a-e4df-47aa-a3c5-540a3c0c870e'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f99b0e5f-4d18-4afb-adb0-33ffd620e3ee tempest-GroupSnapshotsTest-2059132418 None] group_snapshot 1e50cff7-7b19-4695-b3a8-6be1a56abc6b: deleted successfully Nov 02 14:29:32 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c969cf74-c7bb-4b61-a020-8232b6543805 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f" returned: 0 in 0.412s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:32 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f is being set with open permissions: ugo+rw Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:32 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f Nov 02 14:29:32 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:32 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f" returned: 0 in 0.312s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:33 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.info Nov 02 14:29:33 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "cinder-quobyte-51d35497-e228-43e5-9722-19a8f05b2798" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-51d35497-e228-43e5-9722-19a8f05b2798" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a31ac-53bf-49c5-a68a-ed9759a53f1a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:33 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 Nov 02 14:29:33 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:33 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.info" returned: 0 in 0.398s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:33 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.info is being set with open permissions: ugo+rw Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:33 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.info Nov 02 14:29:33 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:33 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798" returned: 0 in 0.408s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:33 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798 Nov 02 14:29:33 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:33 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.info" returned: 0 in 0.280s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:33 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4dfd3e50-6e6b-4eab-8dd4-d9474520e5f7 tempest-VolumesSnapshotTestJSON-158928725 None] Create snapshot completed successfully Nov 02 14:29:33 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-51d35497-e228-43e5-9722-19a8f05b2798" returned: 0 in 0.279s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Lock "cinder-quobyte-51d35497-e228-43e5-9722-19a8f05b2798" released by "delete_volume" :: held 0.770s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['1d57c7bc-c8a8-4e59-ae19-dc80834d0d72'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:34 devstack cinder-volume[86978]: WARNING cinder.quota [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1827473854 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1827473854, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Created reservations ['16d43102-ab11-49d6-9e41-194e944d1ba5', '3f9d3042-64d8-4be9-ba05-3c97fe404d17', 'd9d76778-bca6-4fb5-a873-f30c2b418570', '3b8d7320-9e1b-49c5-ab22-dd6c91f9c5a2'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:34 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:34 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:34 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.274s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a413f503-52f8-48c5-b2fb-5cf6116dc6de tempest-GroupSnapshotsTest-2059132418 None] Delete group completed successfully. Nov 02 14:29:34 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (07688264-09c9-47cd-9eab-dc6d66a0c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37ba2ff-cb3a-4b03-9a41-ffc86e04989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37ba2ff-cb3a-4b03-9a41-ffc86e04989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-420834140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a09c5aa66f794baa89ac1390b43cced5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d83f14fd-26dc-4c08-b56c-49d97481284f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:35Z,use_quota=True,user_id='9325d54c9ca94c8f8409055ea3d5db85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab9496b-e9d8-454b-b57f-f5f941c2a047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab9496b-e9d8-454b-b57f-f5f941c2a047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770a4044-4a33-44bb-8125-adc808329d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770a4044-4a33-44bb-8125-adc808329d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37', 'volume_name': 'volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37', 'volume_size': 1, 'snapshot_id': 'd83f14fd-26dc-4c08-b56c-49d97481284f'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7ffbc0-5b6e-4ca1-ba5c-fa2855c0fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7ffbc0-5b6e-4ca1-ba5c-fa2855c0fcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb23eca-2d81-4c10-87e0-f971dd6c5a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Volume ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37', 'volume_size': 1, 'snapshot_id': 'd83f14fd-26dc-4c08-b56c-49d97481284f'} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-d83f14fd-26dc-4c08-b56c-49d97481284f-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-d83f14fd-26dc-4c08-b56c-49d97481284f-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Creating volume ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 from snapshot d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] snapshot: d83f14fd-26dc-4c08-b56c-49d97481284f, volume: ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[814da4d0-610b-41f7-ae4b-0ef81e4bbd57]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:35 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f Nov 02 14:29:35 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:35 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f" returned: 0 in 0.434s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c969cf74-c7bb-4b61-a020-8232b6543805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0570fce-40b0-42c1-9cd5-00dc7f331300]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:35 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 Nov 02 14:29:35 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:36 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805" returned: 0 in 0.451s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:29:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:29:36 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:29:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:36 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 Nov 02 14:29:36 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:39 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:39 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:39 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.760s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:29:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Flow 'volume_create_manager' (05cbe2cc-e312-4637-9971-2020c53fd67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ffa774-a932-4a48-a7bc-b4a40aba13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ffa774-a932-4a48-a7bc-b4a40aba13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1406006245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09085314b88433e9ba8fe836da6e51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:43Z,use_quota=True,user_id='8a45e3947ded40fb8c902637f0d3b2ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d5834c-a024-415f-ad8a-1d515b0f9e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d5834c-a024-415f-ad8a-1d515b0f9e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3be340-0dc1-4c1d-a42a-7d20b139ecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3be340-0dc1-4c1d-a42a-7d20b139ecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9', 'volume_name': 'volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f281c1de-ac7a-4b53-b486-5a15e4b4a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f281c1de-ac7a-4b53-b486-5a15e4b4a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c696a4e7-ac5e-493c-8b9f-9399a1c3c610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Volume 40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9', 'volume_size': 1} Nov 02 14:29:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:44 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" returned: 0 in 8.138s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805, size 1024.00 MB, duration 8.14 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:29:44 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Converted 1024.00 MB image at 125.81 MB/s Nov 02 14:29:44 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 is being set with open permissions: ugo+rw Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:44 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 Nov 02 14:29:44 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e620efea-9e5e-4627-95bd-bbdcb67ba8cf tempest-GroupsV314Test-350376734 None] Group tempest-GroupsV314Test-Group-1350028232: creating Nov 02 14:29:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e620efea-9e5e-4627-95bd-bbdcb67ba8cf tempest-GroupsV314Test-350376734 None] Group tempest-GroupsV314Test-Group-1350028232: created successfully Nov 02 14:29:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e620efea-9e5e-4627-95bd-bbdcb67ba8cf tempest-GroupsV314Test-350376734 None] Create group completed successfully. Nov 02 14:29:44 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" returned: 0 in 0.245s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" released by "_copy_volume_from_snapshot" :: held 9.368s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-d83f14fd-26dc-4c08-b56c-49d97481284f-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" released by "_create_volume_from_snapshot" :: held 9.431s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.452s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1406006245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e09085314b88433e9ba8fe836da6e51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:43Z,use_quota=True,user_id='8a45e3947ded40fb8c902637f0d3b2ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Creating volume 40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:44 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:44 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 1073741824 Nov 02 14:29:44 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb23eca-2d81-4c10-87e0-f971dd6c5a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37', 'volume_size': 1, 'snapshot_id': 'd83f14fd-26dc-4c08-b56c-49d97481284f'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a591cef6-66a8-4713-9b3b-1bc819df9312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Volume volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 (ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37): created successfully Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a591cef6-66a8-4713-9b3b-1bc819df9312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Flow 'volume_create_manager' (07688264-09c9-47cd-9eab-dc6d66a0c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7a2579f9-c477-4604-9747-74d5292b6361 tempest-VolumesSnapshotTestJSON-158928725 None] Created volume successfully. Nov 02 14:29:45 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 1073741824" returned: 0 in 0.443s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:45 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 Nov 02 14:29:45 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3391b7c8-acb4-457e-83ad-9d6cc3176134]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:45 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" returned: 0 in 0.250s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c696a4e7-ac5e-493c-8b9f-9399a1c3c610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f676b4-8813-451d-be76-333e9fc6c1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Volume volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 (40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9): created successfully Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f676b4-8813-451d-be76-333e9fc6c1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Flow 'volume_create_manager' (05cbe2cc-e312-4637-9971-2020c53fd67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:45 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 Nov 02 14:29:45 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3d7ed9e2-058e-4216-a17f-54d3fe22c85e tempest-SnapshotMetadataTestJSON-951013922 None] Created volume successfully. Nov 02 14:29:45 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" returned: 0 in 0.379s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:45 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37 Nov 02 14:29:45 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:45 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" returned: 0 in 0.268s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37" released by "delete_volume" :: held 0.711s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:45 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Flow 'volume_create_manager' (7d2b8fe6-d3d5-457a-b229-647eee650489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81b9be2-db6f-4e36-8a83-ede65029a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81b9be2-db6f-4e36-8a83-ede65029a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1592086342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87731522-248e-41be-ade8-4f330935de74,host='devstack@QuobyteHD#QuobyteHD',id=78f8263f-e9b2-46ef-95b3-0902fa56321c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c420ba49eae34b6dbb2e31f74eeaf2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:46Z,use_quota=True,user_id='1915558ed9aa4fbd8e216afd74eb4eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(042f2698-93d0-4a07-ad52-5c23586054f3),volume_type_id=042f2698-93d0-4a07-ad52-5c23586054f3)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c553c98-7703-4cad-a524-2509125b5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c553c98-7703-4cad-a524-2509125b5fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f066fe08-49ce-427a-82c2-a68fc5a323b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f066fe08-49ce-427a-82c2-a68fc5a323b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f8263f-e9b2-46ef-95b3-0902fa56321c', 'volume_name': 'volume-78f8263f-e9b2-46ef-95b3-0902fa56321c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0a304b-9b01-44c7-8226-1200fbd39b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0a304b-9b01-44c7-8226-1200fbd39b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f1e788-df0e-4cc1-93c9-537292be62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:46 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Volume 78f8263f-e9b2-46ef-95b3-0902fa56321c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f8263f-e9b2-46ef-95b3-0902fa56321c', 'volume_size': 1} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=87731522-248e-41be-ade8-4f330935de74,created_at=2026-11-02T13:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1592086342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87731522-248e-41be-ade8-4f330935de74,host='devstack@QuobyteHD#QuobyteHD',id=78f8263f-e9b2-46ef-95b3-0902fa56321c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c420ba49eae34b6dbb2e31f74eeaf2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:29:46Z,use_quota=True,user_id='1915558ed9aa4fbd8e216afd74eb4eab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(042f2698-93d0-4a07-ad52-5c23586054f3),volume_type_id=042f2698-93d0-4a07-ad52-5c23586054f3)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Creating volume 78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:29:46 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:46 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c 1073741824 Nov 02 14:29:46 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['ab4992ec-2938-42cf-9ba2-66d9ba6fe0d4', '11aeea47-0465-4230-a287-52069e4737f7', '2875873c-c958-4924-9798-ab6ba4cb8513', '309b7d8f-2b48-4760-9f86-4db80f598d3f'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:46 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:46 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-d83f14fd-26dc-4c08-b56c-49d97481284f-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-d83f14fd-26dc-4c08-b56c-49d97481284f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-c969cf74-c7bb-4b61-a020-8232b6543805" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-c969cf74-c7bb-4b61-a020-8232b6543805" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-d83f14fd-26dc-4c08-b56c-49d97481284f" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-d83f14fd-26dc-4c08-b56c-49d97481284f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Deleting offline snapshot d83f14fd-26dc-4c08-b56c-49d97481284f of volume c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] snapshot_file for this snap is: volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aac983-1710-450c-99f4-2a0ef09f552c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:46 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.368s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Deleted volume successfully. Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-52f516b8-edd9-4cff-befc-947d85cf4628 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-ade2eb9c-dafb-4f94-9e5f-17f96d2f5d37-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:46 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c 1073741824" returned: 0 in 0.553s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:46 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f Nov 02 14:29:46 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:46 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c Nov 02 14:29:46 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:46 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f" returned: 0 in 0.392s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c969cf74-c7bb-4b61-a020-8232b6543805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:46 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.518s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4730d85a-5ea8-4e73-a5eb-fbc804c174ee]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f1e788-df0e-4cc1-93c9-537292be62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f8263f-e9b2-46ef-95b3-0902fa56321c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041ca276-99d6-43bf-96a4-eecaf427fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Creating offline snapshot 7a0bd894-8396-4c69-9198-2e47b5d83bc2 of volume 40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:29:47 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Volume volume-78f8263f-e9b2-46ef-95b3-0902fa56321c (78f8263f-e9b2-46ef-95b3-0902fa56321c): created successfully Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041ca276-99d6-43bf-96a4-eecaf427fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Flow 'volume_create_manager' (7d2b8fe6-d3d5-457a-b229-647eee650489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6f0c1e-45b0-4025-a901-c5522158eccb]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-79e389d8-625b-4a75-8294-c16c683143e6 tempest-GroupsV314Test-350376734 None] Created volume successfully. Nov 02 14:29:47 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 Nov 02 14:29:47 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:47 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 Nov 02 14:29:47 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:47 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" returned: 0 in 0.422s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:47 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 1G Nov 02 14:29:47 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:47 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805" returned: 0 in 0.608s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:47 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f Nov 02 14:29:47 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:48 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 1G" returned: 0 in 0.544s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:48 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 Nov 02 14:29:48 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:48 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f" returned: 0 in 0.511s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:48 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f Nov 02 14:29:48 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:48 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805.d83f14fd-26dc-4c08-b56c-49d97481284f" returned: 0 in 0.319s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:48 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2" returned: 0 in 0.483s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:48 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 is being set with open permissions: ugo+rw Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-d83f14fd-26dc-4c08-b56c-49d97481284f" released by "_delete_snapshot" :: held 2.041s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-c969cf74-c7bb-4b61-a020-8232b6543805" released by "delete_snapshot" :: held 2.080s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:48 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 Nov 02 14:29:48 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['fd7a9008-907e-43f4-92af-335e6d36a90a', '4a3d752d-82cb-4a83-8a91-b19674ae1c6e', '83e69cfc-695c-41b9-b36d-844364b5dd3f', '3c881961-d9d8-4e8d-98fa-554e392c6733'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Delete snapshot completed successfully. Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cd8229d6-cf93-4146-b7f3-87a008c7bcc8 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-d83f14fd-26dc-4c08-b56c-49d97481284f-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:48 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2" returned: 0 in 0.417s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:48 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.info Nov 02 14:29:48 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:49 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.info" returned: 0 in 0.258s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:49 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.info is being set with open permissions: ugo+rw Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:49 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.info Nov 02 14:29:49 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:49 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.info" returned: 0 in 0.254s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.658s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:49 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Cloning volume 78f8263f-e9b2-46ef-95b3-0902fa56321c to volume 93db2d1d-2533-4f70-a03b-f91f17fb75b6 Nov 02 14:29:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d57b4eca-0da7-4c11-9504-2a9e208d20d6 tempest-SnapshotMetadataTestJSON-951013922 None] Create snapshot completed successfully Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Creating offline snapshot 7d58693f-0cfa-44a8-9684-79fa3a03b5a8 of volume 78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ef90c-0235-4d18-908e-dcd94fe8ea3f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:49 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c Nov 02 14:29:49 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-c969cf74-c7bb-4b61-a020-8232b6543805-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-c969cf74-c7bb-4b61-a020-8232b6543805-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-c969cf74-c7bb-4b61-a020-8232b6543805" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-c969cf74-c7bb-4b61-a020-8232b6543805" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52a5b4b-d54c-439c-b53d-a44a61b0c706]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:50 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c" returned: 0 in 0.496s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:50 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 1G Nov 02 14:29:50 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:50 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 Nov 02 14:29:50 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:50 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805" returned: 0 in 0.432s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:50 devstack sudo[96395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805 Nov 02 14:29:50 devstack sudo[96395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:50 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 1G" returned: 0 in 0.520s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f8263f-e9b2-46ef-95b3-0902fa56321c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:50 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f8263f-e9b2-46ef-95b3-0902fa56321c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 Nov 02 14:29:50 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:50 devstack sudo[96395]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c969cf74-c7bb-4b61-a020-8232b6543805" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-c969cf74-c7bb-4b61-a020-8232b6543805" released by "delete_volume" :: held 0.845s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['471bc675-0d14-4ec2-b6ed-8c6b3918c869', '29cb8a0d-62dc-415a-becb-e5cf60c61d52', 'e4b76fdb-5431-4fda-89aa-b5507a52a6de', '256686b9-3e11-4be2-b899-651ed74d1c49'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:51 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f8263f-e9b2-46ef-95b3-0902fa56321c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8" returned: 0 in 0.462s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:51 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:51 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:51 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:51 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 Nov 02 14:29:51 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-80ae1d85-792f-4982-aca2-c2eff7bc396e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-80ae1d85-792f-4982-aca2-c2eff7bc396e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "cinder-quobyte-80ae1d85-792f-4982-aca2-c2eff7bc396e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-80ae1d85-792f-4982-aca2-c2eff7bc396e" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b66310-d19f-4875-9b90-531c71889352]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:51 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:51 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.576s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8" returned: 0 in 0.500s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Deleted volume successfully. Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c084b690-2133-4236-b79c-28acc5202462 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-c969cf74-c7bb-4b61-a020-8232b6543805-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:51 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e Nov 02 14:29:51 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:51 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.info Nov 02 14:29:51 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:52 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "cinder-7a0bd894-8396-4c69-9198-2e47b5d83bc2-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.info" returned: 0 in 0.361s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:52 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:29:52 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e" returned: 0 in 0.586s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:52 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.info Nov 02 14:29:52 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-7a0bd894-8396-4c69-9198-2e47b5d83bc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "cinder-quobyte-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:52 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e Nov 02 14:29:52 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-quobyte-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "cinder-quobyte-7a0bd894-8396-4c69-9198-2e47b5d83bc2" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-quobyte-7a0bd894-8396-4c69-9198-2e47b5d83bc2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Deleting offline snapshot 7a0bd894-8396-4c69-9198-2e47b5d83bc2 of volume 40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] snapshot_file for this snap is: volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c0f16-f03a-4ee8-9b31-79b32d7e9096]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:52 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 Nov 02 14:29:52 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:52 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.info" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:52 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Acquiring lock "cinder-quobyte-93db2d1d-2533-4f70-a03b-f91f17fb75b6" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-80ae1d85-792f-4982-aca2-c2eff7bc396e" returned: 0 in 0.274s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-quobyte-80ae1d85-792f-4982-aca2-c2eff7bc396e" released by "delete_volume" :: held 0.983s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-93db2d1d-2533-4f70-a03b-f91f17fb75b6" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] snapshot: 7d58693f-0cfa-44a8-9684-79fa3a03b5a8, volume: 93db2d1d-2533-4f70-a03b-f91f17fb75b6, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a1d430-6745-4c6e-8dcb-f74eb1412165]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Created reservations ['9750181f-af6e-4d25-ade3-a3e8ffa4ffc4', '0426378d-9e81-4f67-b23a-2542cce1a467', 'a1968051-8f89-45cd-afec-d9ce9cc86835', 'dea2e289-2577-43c5-b72f-7a6e131556c3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:52 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 Nov 02 14:29:52 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:52 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2" returned: 0 in 0.426s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:52 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:52 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4832049-c109-4807-a92b-9813e667ccf9]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:52 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 Nov 02 14:29:52 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:52 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.312s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:52 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Deleted volume successfully. Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8" returned: 0 in 0.453s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78f8263f-e9b2-46ef-95b3-0902fa56321c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b927f37f-48a8-421e-8c22-506e7cf900bf]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c0ccb9d0-f269-4513-9350-fa23142e9c27 tempest-VolumesSnapshotTestJSON-158928725 None] Lock "cinder-80ae1d85-792f-4982-aca2-c2eff7bc396e-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:53 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c Nov 02 14:29:53 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:53 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" returned: 0 in 0.550s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:53 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 Nov 02 14:29:53 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:53 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c" returned: 0 in 0.457s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:53 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 Nov 02 14:29:53 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Acquiring lock "cinder-74414ee5-29b8-42d3-be92-4c5bb50fb60a-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:53 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "cinder-74414ee5-29b8-42d3-be92-4c5bb50fb60a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2" returned: 0 in 0.434s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:53 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2 Nov 02 14:29:53 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Acquiring lock "cinder-quobyte-74414ee5-29b8-42d3-be92-4c5bb50fb60a" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "cinder-quobyte-74414ee5-29b8-42d3-be92-4c5bb50fb60a" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c05e78-052c-4d48-bc9f-fd3bea6c255f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:53 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a Nov 02 14:29:53 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:53 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9.7a0bd894-8396-4c69-9198-2e47b5d83bc2" returned: 0 in 0.296s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-quobyte-7a0bd894-8396-4c69-9198-2e47b5d83bc2" released by "_delete_snapshot" :: held 1.859s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-quobyte-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" released by "delete_snapshot" :: held 1.892s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:54 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Created reservations ['11025ad9-d14d-4f44-8582-abaf1770bf3a', '993c906e-ef92-4259-b6f7-f0fc9ab6fa7d', '5a05fc2a-800d-4cea-bd10-80e5f0a37ef3', '8cbb8104-3cb8-4339-9111-7c8477738f70'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Delete snapshot completed successfully. Nov 02 14:29:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ae185181-d5af-4640-9884-6893bde6b34a tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-7a0bd894-8396-4c69-9198-2e47b5d83bc2-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:54 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a" returned: 0 in 0.695s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:54 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a Nov 02 14:29:54 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:54 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-74414ee5-29b8-42d3-be92-4c5bb50fb60a" returned: 0 in 0.543s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "cinder-quobyte-74414ee5-29b8-42d3-be92-4c5bb50fb60a" released by "delete_volume" :: held 1.312s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Created reservations ['fe774af3-0c3b-49af-b45e-4d8d98ed7f6d', '3d30eaee-8d0c-421e-9cef-7448a199015b', 'fb0ef2fa-c6d8-4d10-980e-319c433a267b', 'bae7d98c-a92a-4f73-88bb-ee825e6265d6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:55 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:55 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "cinder-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "cinder-quobyte-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-quobyte-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a7ad1-51e3-426f-bcc5-91165bcec06e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:55 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.649s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:55 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:56 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Deleted volume successfully. Nov 02 14:29:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-147b5684-b340-4072-b887-0cb12e32e9ba tempest-AttachVolumeShelveTestJSON-1414372403 None] Lock "cinder-74414ee5-29b8-42d3-be92-4c5bb50fb60a-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:56 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 Nov 02 14:29:56 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:56 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" returned: 0 in 0.798s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:56 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9 Nov 02 14:29:56 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:57 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" returned: 0 in 0.524s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-quobyte-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9" released by "delete_volume" :: held 1.505s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=164,cinder:SELECT=180,cinder:INSERT=49,cinder:DELETE=11 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=171,cinder:INSERT=42,cinder:UPDATE=205,cinder:DELETE=10 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Created reservations ['52ac39eb-a995-4b6a-a191-4b10fd6f8cde', '2debcdcc-00c8-4cdf-8d28-3ff0d43cabdd', 'a1f1e788-7893-434f-a536-e94dc9733a1e', '084875ac-db79-406d-993c-8c276fd83a63'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:29:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:29:57 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:29:57 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:29:58 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Nov 02 14:29:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.525s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:29:58 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:29:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Deleted volume successfully. Nov 02 14:29:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-48829c28-4eda-48c3-b0ee-c2c3a2e81d37 tempest-SnapshotMetadataTestJSON-951013922 None] Lock "cinder-40bfb7c8-28c7-42fb-a53b-4ef2b0b79de9-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:02 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6" returned: 0 in 9.213s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:02 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c, size 1024.00 MB, duration 9.21 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:30:02 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Converted 1024.00 MB image at 111.13 MB/s Nov 02 14:30:02 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 14:30:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:02 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 Nov 02 14:30:02 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:02 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6" returned: 0 in 0.356s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-93db2d1d-2533-4f70-a03b-f91f17fb75b6" released by "_copy_volume_from_snapshot" :: held 10.597s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Acquiring lock "cinder-quobyte-7d58693f-0cfa-44a8-9684-79fa3a03b5a8" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-7d58693f-0cfa-44a8-9684-79fa3a03b5a8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Deleting offline snapshot 7d58693f-0cfa-44a8-9684-79fa3a03b5a8 of volume 78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] snapshot_file for this snap is: volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3705d1-44d7-4e83-a533-1be035a295fc]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:03 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 Nov 02 14:30:03 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:03 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8" returned: 0 in 0.472s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78f8263f-e9b2-46ef-95b3-0902fa56321c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d64a18-7ab4-4f55-8802-0bc6b5c0eda5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:03 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c Nov 02 14:30:03 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:04 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c" returned: 0 in 0.854s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:04 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 Nov 02 14:30:04 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:04 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8" returned: 0 in 0.534s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:05 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8 Nov 02 14:30:05 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:05 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c.7d58693f-0cfa-44a8-9684-79fa3a03b5a8" returned: 0 in 0.329s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-7d58693f-0cfa-44a8-9684-79fa3a03b5a8" released by "_delete_snapshot" :: held 2.341s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.877s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:05 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cabb27b3-6246-4129-ad15-c730fb54812a tempest-GroupsV314Test-350376734 None] Create group from source-group-87731522-248e-41be-ade8-4f330935de74 completed successfully. Nov 02 14:30:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Acquiring lock "cinder-quobyte-93db2d1d-2533-4f70-a03b-f91f17fb75b6" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-93db2d1d-2533-4f70-a03b-f91f17fb75b6" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:06 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[772d04d6-3983-4022-a042-f59e07105a0a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:06 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 Nov 02 14:30:06 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:07 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6" returned: 0 in 0.492s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:07 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6 Nov 02 14:30:07 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:07 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Flow 'volume_create_manager' (b8b26ffa-5ca8-4a36-841c-6b22bcdf5307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b362eb6-4d23-46f9-83aa-660142168669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-93db2d1d-2533-4f70-a03b-f91f17fb75b6" returned: 0 in 0.428s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b362eb6-4d23-46f9-83aa-660142168669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-87392224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36e5729-aa9a-41a0-89ed-4512cd7ca98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd8305ab7ee4d1eb1e6e7679557726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:08Z,use_quota=True,user_id='364520ccfd1d4527a0e5a77a4911a345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaca318-176d-41c8-ac22-d2fe4a1734e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaca318-176d-41c8-ac22-d2fe4a1734e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9c7999-3be6-4a88-b9a6-46a40758a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9c7999-3be6-4a88-b9a6-46a40758a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36e5729-aa9a-41a0-89ed-4512cd7ca98d', 'volume_name': 'volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639244e4-3737-40dc-8d17-62487bcbf7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639244e4-3737-40dc-8d17-62487bcbf7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e9e75f-d1ee-4c19-b64c-b73de042f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:07 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Volume e36e5729-aa9a-41a0-89ed-4512cd7ca98d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d', 'volume_size': 1} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-87392224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36e5729-aa9a-41a0-89ed-4512cd7ca98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd8305ab7ee4d1eb1e6e7679557726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:08Z,use_quota=True,user_id='364520ccfd1d4527a0e5a77a4911a345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Creating volume e36e5729-aa9a-41a0-89ed-4512cd7ca98d {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:07 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-93db2d1d-2533-4f70-a03b-f91f17fb75b6" released by "delete_volume" :: held 1.063s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:07 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d 1073741824 Nov 02 14:30:07 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Created reservations ['3d9403a4-ad58-494c-a631-c3f84ff450b9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:07 devstack cinder-volume[86978]: WARNING cinder.quota [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1584812378 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1584812378, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:30:07 devstack cinder-volume[86978]: WARNING cinder.quota [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1584812378 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1584812378, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:30:07 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Created reservations ['a351fc6f-07fe-43ee-9d9a-0618856514fe', '8465262e-77af-44dd-aaea-aff68b53be56', '0f7a7fd9-e354-4823-a6e1-1e2190692b8f', 'cfcdc2f4-bb88-4dd6-9550-9d3a6559c327'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:08 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:08 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:08 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d 1073741824" returned: 0 in 0.728s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:08 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.410s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-930b1571-adb0-4ea1-bf21-019dfb2107f7 tempest-GroupsV314Test-350376734 None] Delete group completed successfully. Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:08 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d Nov 02 14:30:08 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:08 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d" returned: 0 in 0.266s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e9e75f-d1ee-4c19-b64c-b73de042f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa68c8a6-cdbc-44e5-adc0-fdfa09e2b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:08 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Volume volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d (e36e5729-aa9a-41a0-89ed-4512cd7ca98d): created successfully Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa68c8a6-cdbc-44e5-adc0-fdfa09e2b836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Flow 'volume_create_manager' (b8b26ffa-5ca8-4a36-841c-6b22bcdf5307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e7d85caa-ef5d-4107-b6c4-0ec9de2dc8af tempest-AbsoluteLimitsTests-1806154232 None] Created volume successfully. Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Flow 'volume_create_manager' (ce690f58-e180-4c37-8315-5ba14e9c57d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3a3d5d-a54c-4af8-8e5d-238b7ddb9e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3a3d5d-a54c-4af8-8e5d-238b7ddb9e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-588027558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b302f7b9-0619-48ff-9713-fcfe8a1ea363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce480bdad1c244be9919e6b78ae79e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:09Z,use_quota=True,user_id='eae6ccb5609a452c8c38fb643022b904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d468ce-d140-4dc9-bb4b-1a18b8d3c385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d468ce-d140-4dc9-bb4b-1a18b8d3c385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d49418-9215-4046-9063-12bd9ccbcdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d49418-9215-4046-9063-12bd9ccbcdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b302f7b9-0619-48ff-9713-fcfe8a1ea363', 'volume_name': 'volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19531daa-303f-4483-bd3b-2f0eff46e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19531daa-303f-4483-bd3b-2f0eff46e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b527ff7-e021-4089-a152-0edb66320461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:09 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Volume b302f7b9-0619-48ff-9713-fcfe8a1ea363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363', 'volume_size': 1} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-588027558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b302f7b9-0619-48ff-9713-fcfe8a1ea363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce480bdad1c244be9919e6b78ae79e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:09Z,use_quota=True,user_id='eae6ccb5609a452c8c38fb643022b904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Creating volume b302f7b9-0619-48ff-9713-fcfe8a1ea363 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:09 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Acquiring lock "cinder-quobyte-78f8263f-e9b2-46ef-95b3-0902fa56321c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:09 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 1073741824 Nov 02 14:30:09 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-78f8263f-e9b2-46ef-95b3-0902fa56321c" acquired by "delete_volume" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd28c19-6df1-4eed-b976-7b91db279458]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:09 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c Nov 02 14:30:09 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Acquiring lock "cinder-e36e5729-aa9a-41a0-89ed-4512cd7ca98d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Lock "cinder-e36e5729-aa9a-41a0-89ed-4512cd7ca98d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Acquiring lock "cinder-quobyte-e36e5729-aa9a-41a0-89ed-4512cd7ca98d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Lock "cinder-quobyte-e36e5729-aa9a-41a0-89ed-4512cd7ca98d" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:10 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:10 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 1073741824" returned: 0 in 0.666s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c" returned: 0 in 0.508s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d159ac11-6892-45d0-80fe-59b7bf61a803]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:10 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c Nov 02 14:30:10 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:10 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 Nov 02 14:30:10 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:10 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d Nov 02 14:30:10 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:10 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-78f8263f-e9b2-46ef-95b3-0902fa56321c" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Lock "cinder-quobyte-78f8263f-e9b2-46ef-95b3-0902fa56321c" released by "delete_volume" :: held 0.904s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:10 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363" returned: 0 in 0.315s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Created reservations ['70863757-fe14-4944-a21d-50720148eed1'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b527ff7-e021-4089-a152-0edb66320461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4105a99-0f3a-4f56-83a6-9233b7a02600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:10 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Volume volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 (b302f7b9-0619-48ff-9713-fcfe8a1ea363): created successfully Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4105a99-0f3a-4f56-83a6-9233b7a02600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Flow 'volume_create_manager' (ce690f58-e180-4c37-8315-5ba14e9c57d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:10 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6fac27a9-66f6-4e34-9615-f8ef998843c1 tempest-VolumesTestJSON-445161714 None] Created volume successfully. Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Created reservations ['41a52c75-55af-4b1a-9f2f-d38a9ef61e20', '550234ad-4484-4405-a343-e522f6d534b0', 'bc0280c9-cc41-4cd4-b41e-b15841046734', 'd103cdee-6236-48a6-a51b-a800e8325db1'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:10 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d" returned: 0 in 0.509s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:10 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d Nov 02 14:30:10 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:10 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:10 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:11 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e36e5729-aa9a-41a0-89ed-4512cd7ca98d" returned: 0 in 0.411s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Lock "cinder-quobyte-e36e5729-aa9a-41a0-89ed-4512cd7ca98d" released by "delete_volume" :: held 0.987s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:11 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.330s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:11 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ecaecc2b-ee64-4fbe-919b-879123aadb67 tempest-GroupsV314Test-350376734 None] Delete group completed successfully. Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Created reservations ['fc82b3dd-0e12-4e61-9d21-a16820d43023', 'a1055c98-248e-472f-97fe-bd15a93796ef', 'f4971b2d-8042-45f5-9f9c-3dd499a97977', '37bde878-d5b3-46f3-9572-bc999f96a3dc'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:11 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:11 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:11 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:11 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Deleted volume successfully. Nov 02 14:30:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e17e11ff-6f45-4d92-b925-3f57ac2d4561 tempest-AbsoluteLimitsTests-1806154232 None] Lock "cinder-e36e5729-aa9a-41a0-89ed-4512cd7ca98d-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Flow 'volume_create_manager' (ed9a3392-8653-4508-82b7-02d636d09e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd21871-9221-4c4c-93e6-1aff72113f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd21871-9221-4c4c-93e6-1aff72113f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1142188510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9dedef4-193e-4380-8225-9193e40aad48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce480bdad1c244be9919e6b78ae79e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:12Z,use_quota=True,user_id='eae6ccb5609a452c8c38fb643022b904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc040469-01fe-4fde-a7e1-47d68af04ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc040469-01fe-4fde-a7e1-47d68af04ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429b9a22-5ea8-4f02-b0d1-2c0c91ded542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429b9a22-5ea8-4f02-b0d1-2c0c91ded542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9dedef4-193e-4380-8225-9193e40aad48', 'volume_name': 'volume-d9dedef4-193e-4380-8225-9193e40aad48', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533f7dba-4621-473b-bebf-8c13162d796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533f7dba-4621-473b-bebf-8c13162d796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125346c8-22e4-4afe-a974-6023cf2b7565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:12 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Volume d9dedef4-193e-4380-8225-9193e40aad48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9dedef4-193e-4380-8225-9193e40aad48', 'volume_size': 1} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1142188510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9dedef4-193e-4380-8225-9193e40aad48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce480bdad1c244be9919e6b78ae79e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:12Z,use_quota=True,user_id='eae6ccb5609a452c8c38fb643022b904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Creating volume d9dedef4-193e-4380-8225-9193e40aad48 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:12 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:12 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 1073741824 Nov 02 14:30:12 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:13 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 1073741824" returned: 0 in 0.666s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:13 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 Nov 02 14:30:13 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:13 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48" returned: 0 in 0.427s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125346c8-22e4-4afe-a974-6023cf2b7565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9dedef4-193e-4380-8225-9193e40aad48', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a341afca-f394-4325-9ea3-44c9386383df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:13 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Volume volume-d9dedef4-193e-4380-8225-9193e40aad48 (d9dedef4-193e-4380-8225-9193e40aad48): created successfully Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a341afca-f394-4325-9ea3-44c9386383df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Flow 'volume_create_manager' (ed9a3392-8653-4508-82b7-02d636d09e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0af829c4-960d-4bb6-9ecd-545d58dc0169 tempest-VolumesTestJSON-445161714 None] Created volume successfully. Nov 02 14:30:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Flow 'volume_create_manager' (40bf895c-f57b-46c2-a3eb-481c0e6457fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d7f953-96ee-4729-acd5-bea110eebb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d7f953-96ee-4729-acd5-bea110eebb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813358823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a120fdc-146a-4888-9cbc-311dd1baf63d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce480bdad1c244be9919e6b78ae79e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:15Z,use_quota=True,user_id='eae6ccb5609a452c8c38fb643022b904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0722eb67-cdc9-4e69-b705-b15e9d84a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0722eb67-cdc9-4e69-b705-b15e9d84a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6d1fe5-42af-46c0-9cd0-ccc4005e697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6d1fe5-42af-46c0-9cd0-ccc4005e697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a120fdc-146a-4888-9cbc-311dd1baf63d', 'volume_name': 'volume-9a120fdc-146a-4888-9cbc-311dd1baf63d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e53d5b-96a2-4d67-9923-d16260f86a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e53d5b-96a2-4d67-9923-d16260f86a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adec12b2-87b0-411d-999c-f440caeb9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Volume 9a120fdc-146a-4888-9cbc-311dd1baf63d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a120fdc-146a-4888-9cbc-311dd1baf63d', 'volume_size': 1} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813358823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a120fdc-146a-4888-9cbc-311dd1baf63d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce480bdad1c244be9919e6b78ae79e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:15Z,use_quota=True,user_id='eae6ccb5609a452c8c38fb643022b904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Creating volume 9a120fdc-146a-4888-9cbc-311dd1baf63d {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:15 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:15 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d 1073741824 Nov 02 14:30:15 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:15 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d 1073741824" returned: 0 in 0.567s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:15 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d Nov 02 14:30:15 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:16 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adec12b2-87b0-411d-999c-f440caeb9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a120fdc-146a-4888-9cbc-311dd1baf63d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a6b5aa-77ec-4a0d-8ba3-89e2322709fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:16 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Volume volume-9a120fdc-146a-4888-9cbc-311dd1baf63d (9a120fdc-146a-4888-9cbc-311dd1baf63d): created successfully Nov 02 14:30:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a6b5aa-77ec-4a0d-8ba3-89e2322709fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Flow 'volume_create_manager' (40bf895c-f57b-46c2-a3eb-481c0e6457fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8453fc67-ade2-4b06-bd93-ba982ee34d2e tempest-VolumesTestJSON-445161714 None] Created volume successfully. Nov 02 14:30:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Acquiring lock "cinder-9a120fdc-146a-4888-9cbc-311dd1baf63d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Lock "cinder-9a120fdc-146a-4888-9cbc-311dd1baf63d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Acquiring lock "cinder-quobyte-9a120fdc-146a-4888-9cbc-311dd1baf63d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Lock "cinder-quobyte-9a120fdc-146a-4888-9cbc-311dd1baf63d" acquired by "delete_volume" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:18 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a01f7-8a5d-4073-9f8b-4ae5336904ae]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:19 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d Nov 02 14:30:19 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:19 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d" returned: 0 in 0.525s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:19 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d Nov 02 14:30:19 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:19 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9a120fdc-146a-4888-9cbc-311dd1baf63d" returned: 0 in 0.360s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Lock "cinder-quobyte-9a120fdc-146a-4888-9cbc-311dd1baf63d" released by "delete_volume" :: held 0.963s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Created reservations ['86ef5dae-6a17-4a83-839c-2532a42cdba3', '39e6a972-4686-4429-aa7f-97fd83f25bf4', 'be348f2b-c704-4d03-894f-bd7156511ba2', '4ecb61e8-1c08-419f-a7ba-fd46edf70082'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:20 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:20 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:20 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.307s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:20 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Deleted volume successfully. Nov 02 14:30:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-09e42376-cb4e-450c-b73f-f01bb66e8199 tempest-VolumesTestJSON-445161714 None] Lock "cinder-9a120fdc-146a-4888-9cbc-311dd1baf63d-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Acquiring lock "cinder-d9dedef4-193e-4380-8225-9193e40aad48-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Lock "cinder-d9dedef4-193e-4380-8225-9193e40aad48-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Acquiring lock "cinder-quobyte-d9dedef4-193e-4380-8225-9193e40aad48" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Lock "cinder-quobyte-d9dedef4-193e-4380-8225-9193e40aad48" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d325c1-67ad-4740-a779-9e56bf492d2b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:21 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 Nov 02 14:30:21 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Flow 'volume_create_manager' (7be16c88-3718-4be4-a731-9278cca8d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3232a2cb-c71f-49c1-99e8-96653703323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3232a2cb-c71f-49c1-99e8-96653703323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-710122509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc46593-3dd1-444d-8d97-bab65a780f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c873fec6009b4ad68f94586b8933684d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:22Z,use_quota=True,user_id='394fdc70424c42e0b636ea3594b87a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240a71bf-5c3f-4acc-8d99-297973974c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240a71bf-5c3f-4acc-8d99-297973974c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cd22a3-3796-435c-96f2-96a8ff2fbb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cd22a3-3796-435c-96f2-96a8ff2fbb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc46593-3dd1-444d-8d97-bab65a780f60', 'volume_name': 'volume-3bc46593-3dd1-444d-8d97-bab65a780f60', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4dbb721-60a0-4338-a8c6-04e74c21ede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4dbb721-60a0-4338-a8c6-04e74c21ede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa8b4ec-45be-45ae-abb2-54c89ee42582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:21 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Volume 3bc46593-3dd1-444d-8d97-bab65a780f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc46593-3dd1-444d-8d97-bab65a780f60', 'volume_size': 1} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:21 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-710122509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc46593-3dd1-444d-8d97-bab65a780f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c873fec6009b4ad68f94586b8933684d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:22Z,use_quota=True,user_id='394fdc70424c42e0b636ea3594b87a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Creating volume 3bc46593-3dd1-444d-8d97-bab65a780f60 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:21 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48" returned: 0 in 0.491s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:21 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 1073741824 Nov 02 14:30:21 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:21 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48 Nov 02 14:30:21 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:22 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d9dedef4-193e-4380-8225-9193e40aad48" returned: 0 in 0.385s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Lock "cinder-quobyte-d9dedef4-193e-4380-8225-9193e40aad48" released by "delete_volume" :: held 0.942s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Created reservations ['d5c35a61-2b0d-42c9-abfb-b8ce8588b496', '108f4460-1030-4d55-980e-433f537b3515', '8e695738-9c69-4433-a1f1-ac1a68cb6c0a', '9480f12c-986e-44d6-9855-64782e6b54bf'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:22 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 1073741824" returned: 0 in 0.617s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:22 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:22 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:22 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 Nov 02 14:30:22 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:22 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Deleted volume successfully. Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3a2bfa1d-9717-45c0-a709-895ad95e02af tempest-VolumesTestJSON-445161714 None] Lock "cinder-d9dedef4-193e-4380-8225-9193e40aad48-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:22 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60" returned: 0 in 0.339s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa8b4ec-45be-45ae-abb2-54c89ee42582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc46593-3dd1-444d-8d97-bab65a780f60', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02f6e9a-d3fe-4223-9940-7591e55a0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Volume volume-3bc46593-3dd1-444d-8d97-bab65a780f60 (3bc46593-3dd1-444d-8d97-bab65a780f60): created successfully Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02f6e9a-d3fe-4223-9940-7591e55a0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Flow 'volume_create_manager' (7be16c88-3718-4be4-a731-9278cca8d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6757b4da-ff95-4f79-b963-f58ca5a679e6 tempest-VolumesMetadataTest-616982353 None] Created volume successfully. Nov 02 14:30:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Acquiring lock "cinder-b302f7b9-0619-48ff-9713-fcfe8a1ea363-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Lock "cinder-b302f7b9-0619-48ff-9713-fcfe8a1ea363-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Acquiring lock "cinder-quobyte-b302f7b9-0619-48ff-9713-fcfe8a1ea363" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Lock "cinder-quobyte-b302f7b9-0619-48ff-9713-fcfe8a1ea363" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b89eb58-5c94-48fb-a58b-b2af2c7e8c4d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:23 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 Nov 02 14:30:23 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:24 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363" returned: 0 in 0.533s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:24 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363 Nov 02 14:30:24 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:24 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b302f7b9-0619-48ff-9713-fcfe8a1ea363" returned: 0 in 0.352s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Lock "cinder-quobyte-b302f7b9-0619-48ff-9713-fcfe8a1ea363" released by "delete_volume" :: held 0.954s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Created reservations ['d60c44aa-ff25-456b-9948-26db7c4e738d', '28d97518-479d-429c-ac86-34bac8c5a951', '3759da9f-8802-4cbe-8502-7373402c44bd', 'f731f271-712b-4f97-8b4f-73abb0287593'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:24 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:24 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Acquiring lock "cinder-3bc46593-3dd1-444d-8d97-bab65a780f60-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Lock "cinder-3bc46593-3dd1-444d-8d97-bab65a780f60-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:25 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.461s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Deleted volume successfully. Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Acquiring lock "cinder-quobyte-3bc46593-3dd1-444d-8d97-bab65a780f60" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fddfb423-36eb-4e5f-a041-4e7d28a9253d tempest-VolumesTestJSON-445161714 None] Lock "cinder-b302f7b9-0619-48ff-9713-fcfe8a1ea363-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Lock "cinder-quobyte-3bc46593-3dd1-444d-8d97-bab65a780f60" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b3357-6ed9-4b16-9386-e026472d2d97]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:25 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 Nov 02 14:30:25 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:25 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60" returned: 0 in 0.552s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:25 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60 Nov 02 14:30:25 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:26 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3bc46593-3dd1-444d-8d97-bab65a780f60" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Lock "cinder-quobyte-3bc46593-3dd1-444d-8d97-bab65a780f60" released by "delete_volume" :: held 0.985s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Created reservations ['600b8fee-7ce4-491f-9a8f-114ed3ae1ed9', '0b5237f1-ea46-497e-864a-cd01c74393be', '9762133e-4b0a-4578-b525-af141b87dfb1', 'ff391674-604e-4908-840e-009c35b882c6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:26 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:26 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:26 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.317s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Deleted volume successfully. Nov 02 14:30:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-238054a8-c5c2-4cd8-b5d4-3146d17a524d tempest-VolumesMetadataTest-616982353 None] Lock "cinder-3bc46593-3dd1-444d-8d97-bab65a780f60-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:36 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=56,cinder:INSERT=22,cinder:UPDATE=87,cinder:DELETE=6 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:30:36 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:INSERT=17,cinder:UPDATE=87,cinder:SELECT=56,cinder:DELETE=5 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Flow 'volume_create_manager' (170a7abe-506f-4322-a36c-1114a3d93246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35deaf57-36ff-4494-bbc5-7d06bf05cadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35deaf57-36ff-4494-bbc5-7d06bf05cadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-59810570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac07fc01-3155-49f4-9ed1-23abe43cd183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d97f3ccda40388bdc04c022e7d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:38Z,use_quota=True,user_id='3d8470e23c7d488491dbed47e79d1303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d8024b-9023-466f-a3b7-f98a1c0d7402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d8024b-9023-466f-a3b7-f98a1c0d7402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fcea4a-8939-4e63-9b24-bb36061341a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fcea4a-8939-4e63-9b24-bb36061341a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac07fc01-3155-49f4-9ed1-23abe43cd183', 'volume_name': 'volume-ac07fc01-3155-49f4-9ed1-23abe43cd183', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0021c8a3-9247-45e3-8c0b-624c4fc5ced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0021c8a3-9247-45e3-8c0b-624c4fc5ced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48da97c-d727-4c0e-a676-9684077cb2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:38 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Volume ac07fc01-3155-49f4-9ed1-23abe43cd183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac07fc01-3155-49f4-9ed1-23abe43cd183', 'volume_size': 1} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-59810570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac07fc01-3155-49f4-9ed1-23abe43cd183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d97f3ccda40388bdc04c022e7d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:38Z,use_quota=True,user_id='3d8470e23c7d488491dbed47e79d1303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Creating volume ac07fc01-3155-49f4-9ed1-23abe43cd183 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:38 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:38 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 1073741824 Nov 02 14:30:38 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:39 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 1073741824" returned: 0 in 0.694s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:39 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:39 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:39 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 Nov 02 14:30:39 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:39 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183" returned: 0 in 0.346s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48da97c-d727-4c0e-a676-9684077cb2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac07fc01-3155-49f4-9ed1-23abe43cd183', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32c8ea-85d6-482f-8850-15371243fd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:39 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.474s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:30:39 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Volume volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 (ac07fc01-3155-49f4-9ed1-23abe43cd183): created successfully Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb32c8ea-85d6-482f-8850-15371243fd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Flow 'volume_create_manager' (170a7abe-506f-4322-a36c-1114a3d93246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:39 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-40d6804a-9873-4a32-8f91-46fca450f15d tempest-VolumesTransfersV355Test-1250392517 None] Created volume successfully. Nov 02 14:30:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7370c6fb-042a-42d4-b0c0-7977c59bb260 tempest-VolumesTransfersV355Test-926113886 None] Transfer volume completed successfully. Nov 02 14:30:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Acquiring lock "cinder-ac07fc01-3155-49f4-9ed1-23abe43cd183-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-ac07fc01-3155-49f4-9ed1-23abe43cd183-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Acquiring lock "cinder-quobyte-ac07fc01-3155-49f4-9ed1-23abe43cd183" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-quobyte-ac07fc01-3155-49f4-9ed1-23abe43cd183" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:43 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb5525a-413b-4014-8957-12397590834c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:44 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 Nov 02 14:30:44 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:44 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183" returned: 0 in 0.573s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:44 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183 Nov 02 14:30:44 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:45 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ac07fc01-3155-49f4-9ed1-23abe43cd183" returned: 0 in 0.613s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-quobyte-ac07fc01-3155-49f4-9ed1-23abe43cd183" released by "delete_volume" :: held 1.282s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Created reservations ['395f36ba-554c-4245-b0c0-5bc656b11f36', '11edf236-d548-4044-8b46-febcdedacf64', 'f30a7ed4-5683-4cf8-950e-d5e44db8ab6b', 'd974f87b-1ce2-4387-8af7-adaec907fe6f'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:45 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:45 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:45 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.330s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Deleted volume successfully. Nov 02 14:30:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f1acc537-8a9e-4253-b090-7a711bc53e9d tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-ac07fc01-3155-49f4-9ed1-23abe43cd183-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Flow 'volume_create_manager' (924dd7c5-cf89-48ab-a5ae-ceac89701a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2159faa1-9c29-4e54-83ff-1160b0f7e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2159faa1-9c29-4e54-83ff-1160b0f7e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2075398816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f01d674-e2db-4b26-9282-a82ff97ab7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9116c8dba71499d85cc53271dc01198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:46Z,use_quota=True,user_id='06e58cb3f1cf4ccbb3c817fbfae2a7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b98787-ea1f-40c8-a56d-2f3e32db8eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b98787-ea1f-40c8-a56d-2f3e32db8eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1120a1a-7727-43b3-8e61-f959635c4009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1120a1a-7727-43b3-8e61-f959635c4009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f01d674-e2db-4b26-9282-a82ff97ab7d3', 'volume_name': 'volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24c8d3c-a84d-4245-b4cf-58bceb5efce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24c8d3c-a84d-4245-b4cf-58bceb5efce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7920058-506c-4f47-adb5-3eb19025fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:46 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Volume 3f01d674-e2db-4b26-9282-a82ff97ab7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3', 'volume_size': 1} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2075398816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f01d674-e2db-4b26-9282-a82ff97ab7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9116c8dba71499d85cc53271dc01198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:46Z,use_quota=True,user_id='06e58cb3f1cf4ccbb3c817fbfae2a7e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Creating volume 3f01d674-e2db-4b26-9282-a82ff97ab7d3 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:46 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:46 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 1073741824 Nov 02 14:30:46 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:46 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 1073741824" returned: 0 in 0.699s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:47 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 Nov 02 14:30:47 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Flow 'volume_create_manager' (fc99efbf-7927-4075-aff4-8d69ea6ba271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5b2b03-09d4-4695-9541-fa17f1230999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5b2b03-09d4-4695-9541-fa17f1230999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-908374496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a7e734-9e40-41eb-922e-1edff500d276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d97f3ccda40388bdc04c022e7d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:47Z,use_quota=True,user_id='3d8470e23c7d488491dbed47e79d1303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797b66e6-4d9a-4e57-bf9b-24b3db82f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797b66e6-4d9a-4e57-bf9b-24b3db82f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e4d9ac-6c66-44ee-81f8-679c51e83e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22e4d9ac-6c66-44ee-81f8-679c51e83e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a7e734-9e40-41eb-922e-1edff500d276', 'volume_name': 'volume-64a7e734-9e40-41eb-922e-1edff500d276', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4620b76-429f-474f-9501-14fbd3a62737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4620b76-429f-474f-9501-14fbd3a62737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c11028-19c2-4e35-8cd4-7e91ea08577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:47 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Volume 64a7e734-9e40-41eb-922e-1edff500d276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a7e734-9e40-41eb-922e-1edff500d276', 'volume_size': 1} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:47 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3" returned: 0 in 0.551s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.214s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-908374496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a7e734-9e40-41eb-922e-1edff500d276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63d97f3ccda40388bdc04c022e7d250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:47Z,use_quota=True,user_id='3d8470e23c7d488491dbed47e79d1303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Creating volume 64a7e734-9e40-41eb-922e-1edff500d276 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:47 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7920058-506c-4f47-adb5-3eb19025fca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:47 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 1073741824 Nov 02 14:30:47 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37bd6f2-f6d1-48de-9f38-8469812f0488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:47 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Volume volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 (3f01d674-e2db-4b26-9282-a82ff97ab7d3): created successfully Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f37bd6f2-f6d1-48de-9f38-8469812f0488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Flow 'volume_create_manager' (924dd7c5-cf89-48ab-a5ae-ceac89701a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-37e9649f-91f3-424b-920e-6ab4acf0cf3f tempest-TestMinimumBasicScenario-321965529 None] Created volume successfully. Nov 02 14:30:48 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 1073741824" returned: 0 in 0.619s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:48 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 Nov 02 14:30:48 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:48 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276" returned: 0 in 0.344s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c11028-19c2-4e35-8cd4-7e91ea08577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a7e734-9e40-41eb-922e-1edff500d276', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d9b8d3-b0fb-49af-a94e-0c6476763bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:48 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Volume volume-64a7e734-9e40-41eb-922e-1edff500d276 (64a7e734-9e40-41eb-922e-1edff500d276): created successfully Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d9b8d3-b0fb-49af-a94e-0c6476763bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Flow 'volume_create_manager' (fc99efbf-7927-4075-aff4-8d69ea6ba271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-19c207d1-f38a-4524-a078-826282945647 tempest-VolumesTransfersV355Test-1250392517 None] Created volume successfully. Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Flow 'volume_create_manager' (2eb0fbec-f8ec-47f3-adee-39156767f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63317fc-a005-4948-8ae6-187a6cbfaabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63317fc-a005-4948-8ae6-187a6cbfaabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2029713217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e30e86a-9971-4faa-932e-8127d07c6542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235b0454a0a5402793c3f81f498d7db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:49Z,use_quota=True,user_id='9f77103a31744191a0dcb34bef7d3927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b30f14-d9f9-429b-a470-5a89259dc3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b30f14-d9f9-429b-a470-5a89259dc3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3bbcff-a907-408f-a294-1b66d239e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3bbcff-a907-408f-a294-1b66d239e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e30e86a-9971-4faa-932e-8127d07c6542', 'volume_name': 'volume-3e30e86a-9971-4faa-932e-8127d07c6542', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b05094a-c5fe-4ea4-a31e-1fb7e430eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b05094a-c5fe-4ea4-a31e-1fb7e430eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c662ed23-fbc5-4ac6-9a4d-016843001d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:49 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Volume 3e30e86a-9971-4faa-932e-8127d07c6542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e30e86a-9971-4faa-932e-8127d07c6542', 'volume_size': 1} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2029713217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e30e86a-9971-4faa-932e-8127d07c6542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235b0454a0a5402793c3f81f498d7db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:30:49Z,use_quota=True,user_id='9f77103a31744191a0dcb34bef7d3927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Creating volume 3e30e86a-9971-4faa-932e-8127d07c6542 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:30:49 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:49 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 1073741824 Nov 02 14:30:49 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Acquiring lock "cinder-64a7e734-9e40-41eb-922e-1edff500d276-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-64a7e734-9e40-41eb-922e-1edff500d276-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-a7c11eb7-cd01-49c8-a4a3-45bb885a8ee3 req-7d179344-4abc-4c1e-a150-498336468e62 tempest-TestMinimumBasicScenario-321965529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Acquiring lock "cinder-quobyte-64a7e734-9e40-41eb-922e-1edff500d276" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-quobyte-64a7e734-9e40-41eb-922e-1edff500d276" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc40f7f-45b9-45c3-a6c6-4aed32b0273e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:49 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 1073741824" returned: 0 in 0.825s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:49 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 Nov 02 14:30:49 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:49 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 Nov 02 14:30:49 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:50 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276" returned: 0 in 0.459s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:50 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542" returned: 0 in 0.342s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:50 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276 Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-a7c11eb7-cd01-49c8-a4a3-45bb885a8ee3 req-7d179344-4abc-4c1e-a150-498336468e62 tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.581s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:50 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c662ed23-fbc5-4ac6-9a4d-016843001d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e30e86a-9971-4faa-932e-8127d07c6542', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd59226-9c9d-4104-9383-d1350a76cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-a7c11eb7-cd01-49c8-a4a3-45bb885a8ee3 req-7d179344-4abc-4c1e-a150-498336468e62 tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:50 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Volume volume-3e30e86a-9971-4faa-932e-8127d07c6542 (3e30e86a-9971-4faa-932e-8127d07c6542): created successfully Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd59226-9c9d-4104-9383-d1350a76cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Flow 'volume_create_manager' (2eb0fbec-f8ec-47f3-adee-39156767f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:30:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-455cf255-3c41-4964-8472-3186a36c5e68 tempest-VolumesServicesTestJSON-813673731 None] Created volume successfully. Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-a7c11eb7-cd01-49c8-a4a3-45bb885a8ee3 req-7d179344-4abc-4c1e-a150-498336468e62 tempest-TestMinimumBasicScenario-321965529 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f0a2003-9cda-4362-9f6f-e563aabfb231', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:30:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-a7c11eb7-cd01-49c8-a4a3-45bb885a8ee3 req-7d179344-4abc-4c1e-a150-498336468e62 tempest-TestMinimumBasicScenario-321965529 None] attachment_update completed successfully. Nov 02 14:30:50 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-64a7e734-9e40-41eb-922e-1edff500d276" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-quobyte-64a7e734-9e40-41eb-922e-1edff500d276" released by "delete_volume" :: held 0.939s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Created reservations ['21540bfe-4303-4edd-b9ae-3f8ba3827007', '81ec4665-29cb-4a15-b02c-c113b6c584ea', '72938c06-1f4a-429c-99b0-0064b32fe144', '7c5f3888-fc27-4598-996c-f5f5ca5b7fcf'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:50 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:50 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Acquiring lock "cinder-3e30e86a-9971-4faa-932e-8127d07c6542-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Lock "cinder-3e30e86a-9971-4faa-932e-8127d07c6542-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Acquiring lock "cinder-quobyte-3e30e86a-9971-4faa-932e-8127d07c6542" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Lock "cinder-quobyte-3e30e86a-9971-4faa-932e-8127d07c6542" acquired by "delete_volume" :: waited 0.043s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:30:51 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.615s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Deleted volume successfully. Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bebd8f-eccf-4c82-9ffd-0e18af22b35a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-28096bea-8771-4036-9ca4-c870937f7b26 tempest-VolumesTransfersV355Test-92199546 None] Lock "cinder-64a7e734-9e40-41eb-922e-1edff500d276-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:51 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 Nov 02 14:30:51 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:52 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542" returned: 0 in 0.522s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:52 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542 Nov 02 14:30:52 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:52 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3e30e86a-9971-4faa-932e-8127d07c6542" returned: 0 in 0.311s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Lock "cinder-quobyte-3e30e86a-9971-4faa-932e-8127d07c6542" released by "delete_volume" :: held 0.916s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Created reservations ['384ab17b-c8ee-4e60-a6d9-7c093bab7b0e', '5476d86b-98e8-422e-aa37-6cb8ae1d2e36', '3ac65e25-e695-4317-875b-861a8aa9d909', '0d5228ae-a789-4696-a483-40e39def1e3a'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:30:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:30:52 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:30:52 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:30:53 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Nov 02 14:30:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.490s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:30:53 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:30:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Deleted volume successfully. Nov 02 14:30:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ba0cea5b-162c-49bb-b167-4322965d2b6b tempest-VolumesServicesTestJSON-813673731 None] Lock "cinder-3e30e86a-9971-4faa-932e-8127d07c6542-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Flow 'volume_create_manager' (27539284-edd7-423f-8a52-dcc6ced65962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d322111d-385e-4d7d-b44d-485bc97df76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d322111d-385e-4d7d-b44d-485bc97df76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-131850916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad065f8-3360-47de-b517-abc56d854aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d3bf3ea6034964a5293c20547f08a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:00Z,use_quota=True,user_id='82933421d5ca47fd8975a7a1d9a9c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66f7e35b-0909-4c2e-a6b8-95c7b938544c),volume_type_id=66f7e35b-0909-4c2e-a6b8-95c7b938544c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a41d5f6-c372-4889-9fc6-ee39b5f01d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a41d5f6-c372-4889-9fc6-ee39b5f01d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81064af-b327-4732-aaa1-14c9afde7a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81064af-b327-4732-aaa1-14c9afde7a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad065f8-3360-47de-b517-abc56d854aac', 'volume_name': 'volume-cad065f8-3360-47de-b517-abc56d854aac', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbea32a-9643-492d-8e12-5741fc2d210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbea32a-9643-492d-8e12-5741fc2d210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ed1c8-17f4-415c-bafc-fcd64f9818b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:00 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Volume cad065f8-3360-47de-b517-abc56d854aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad065f8-3360-47de-b517-abc56d854aac', 'volume_size': 1} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-131850916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad065f8-3360-47de-b517-abc56d854aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d3bf3ea6034964a5293c20547f08a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:00Z,use_quota=True,user_id='82933421d5ca47fd8975a7a1d9a9c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(66f7e35b-0909-4c2e-a6b8-95c7b938544c),volume_type_id=66f7e35b-0909-4c2e-a6b8-95c7b938544c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Creating volume cad065f8-3360-47de-b517-abc56d854aac {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:00 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:00 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac 1073741824 Nov 02 14:31:00 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:00 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac 1073741824" returned: 0 in 0.593s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:00 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac Nov 02 14:31:00 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:01 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac" returned: 0 in 0.297s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738ed1c8-17f4-415c-bafc-fcd64f9818b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad065f8-3360-47de-b517-abc56d854aac', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd0501b-33b3-4123-ab98-224ea98b4a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:01 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Volume volume-cad065f8-3360-47de-b517-abc56d854aac (cad065f8-3360-47de-b517-abc56d854aac): created successfully Nov 02 14:31:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd0501b-33b3-4123-ab98-224ea98b4a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Flow 'volume_create_manager' (27539284-edd7-423f-8a52-dcc6ced65962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:01 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-29c1cb33-ddc9-4144-a293-d3c91cfe3679 tempest-VolumeTypesAccessTest-286397548 None] Created volume successfully. Nov 02 14:31:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Acquiring lock "cinder-cad065f8-3360-47de-b517-abc56d854aac-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Lock "cinder-cad065f8-3360-47de-b517-abc56d854aac-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Acquiring lock "cinder-quobyte-cad065f8-3360-47de-b517-abc56d854aac" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Lock "cinder-quobyte-cad065f8-3360-47de-b517-abc56d854aac" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:02 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb64384-5602-441f-af01-89be5b657f64]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:02 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac Nov 02 14:31:02 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:03 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac" returned: 0 in 0.763s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:03 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac Nov 02 14:31:03 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:03 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-cad065f8-3360-47de-b517-abc56d854aac" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Lock "cinder-quobyte-cad065f8-3360-47de-b517-abc56d854aac" released by "delete_volume" :: held 1.187s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Flow 'volume_create_manager' (1145ecc0-f576-4258-ab33-a78e0b0578ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c1f7ce-b522-4344-bed1-81313b370d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c1f7ce-b522-4344-bed1-81313b370d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-499029530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bebd53-d6b4-4f4e-a84f-3c29ce0604ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48acc67163494ea1828153d2a0c3bb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:04Z,use_quota=True,user_id='991f88e0481f4a17b8fe7cb54ec2a4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6ce323-c270-4391-8770-334ba8a3377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6ce323-c270-4391-8770-334ba8a3377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0920412-188b-4784-9810-297f745a0572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0920412-188b-4784-9810-297f745a0572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bebd53-d6b4-4f4e-a84f-3c29ce0604ca', 'volume_name': 'volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca', 'volume_size': 2}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aae5f03-c8fe-43f6-a9ae-7cb414947d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aae5f03-c8fe-43f6-a9ae-7cb414947d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd906ac-39f0-4a7f-b6cd-2ecca90771c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:03 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Volume 94bebd53-d6b4-4f4e-a84f-3c29ce0604ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca', 'volume_size': 2} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-499029530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bebd53-d6b4-4f4e-a84f-3c29ce0604ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48acc67163494ea1828153d2a0c3bb23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:04Z,use_quota=True,user_id='991f88e0481f4a17b8fe7cb54ec2a4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Creating volume 94bebd53-d6b4-4f4e-a84f-3c29ce0604ca {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:03 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca 2147483648 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:03 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca 2147483648 Nov 02 14:31:03 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:03 devstack cinder-volume[86978]: WARNING cinder.quota [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-78211811 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-78211811, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:31:03 devstack cinder-volume[86978]: WARNING cinder.quota [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-78211811 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-78211811, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:31:03 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Created reservations ['17bd0476-9c32-4772-b4b8-9a7fce56cc58', '8f071273-19ee-4c76-aef1-e177e5943bf7', '46ff6f3f-e381-4192-9dd6-3eaaf0dc6089', '8d051e2e-dc80-49ff-bca6-ab65a5ad8ac1'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:04 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:04 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:04 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.298s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Deleted volume successfully. Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5f13ff01-e1f7-48d8-a654-c56e28476f32 tempest-VolumeTypesAccessTest-286397548 None] Lock "cinder-cad065f8-3360-47de-b517-abc56d854aac-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:04 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca 2147483648" returned: 0 in 0.609s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:04 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca Nov 02 14:31:04 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:04 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd906ac-39f0-4a7f-b6cd-2ecca90771c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca', 'volume_size': 2}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd46661-415a-4a81-91fa-711b4784d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:04 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Volume volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca (94bebd53-d6b4-4f4e-a84f-3c29ce0604ca): created successfully Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd46661-415a-4a81-91fa-711b4784d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Flow 'volume_create_manager' (1145ecc0-f576-4258-ab33-a78e0b0578ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-616e1561-f0a0-4687-8a14-31a626b0596e tempest-VolumesCloneNegativeTest-1232001190 None] Created volume successfully. Nov 02 14:31:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Acquiring lock "cinder-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Lock "cinder-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Acquiring lock "cinder-quobyte-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Lock "cinder-quobyte-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca" acquired by "delete_volume" :: waited 0.035s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2460740-44f1-41b5-b00e-77e0bdc714ad]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:06 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca Nov 02 14:31:06 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:06 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca" returned: 0 in 0.483s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:06 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca Nov 02 14:31:06 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:06 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca" returned: 0 in 0.322s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Lock "cinder-quobyte-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca" released by "delete_volume" :: held 0.885s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Created reservations ['116c2d7f-a937-4135-a187-938434ff2ce5', '853c364f-d209-4f1e-88de-31fc913f869d', '5f73b980-eae1-476c-8a63-7703334c5288', 'e531abec-bb21-4fd1-9c6f-036b2b422e52'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:07 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:07 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:07 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:07 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Deleted volume successfully. Nov 02 14:31:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9e4b409e-9e26-4dc6-8136-bf215506c166 tempest-VolumesCloneNegativeTest-1232001190 None] Lock "cinder-94bebd53-d6b4-4f4e-a84f-3c29ce0604ca-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (c32bc725-fc54-4b3f-af22-1e9567408f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce90d2be-11f1-40a6-ac38-3cad52dc3a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce90d2be-11f1-40a6-ac38-3cad52dc3a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1890644834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00eefa04-11bd-489d-88ba-361e2b31cf14,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:14Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7558a5-89cd-4ea3-ac83-4b38d6fdee13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7558a5-89cd-4ea3-ac83-4b38d6fdee13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5c7994-6197-4d20-8161-41e739ef6528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5c7994-6197-4d20-8161-41e739ef6528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00eefa04-11bd-489d-88ba-361e2b31cf14', 'volume_name': 'volume-00eefa04-11bd-489d-88ba-361e2b31cf14', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34c1873-ecb5-400d-88df-889d957410be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34c1873-ecb5-400d-88df-889d957410be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9860858-8ae2-4324-bc3d-a04c96a40f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:14 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Volume 00eefa04-11bd-489d-88ba-361e2b31cf14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00eefa04-11bd-489d-88ba-361e2b31cf14', 'volume_size': 1} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1890644834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00eefa04-11bd-489d-88ba-361e2b31cf14,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:14Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Creating volume 00eefa04-11bd-489d-88ba-361e2b31cf14 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:14 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:14 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 1073741824 Nov 02 14:31:14 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:15 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 1073741824" returned: 0 in 0.617s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:15 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 Nov 02 14:31:15 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:15 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14" returned: 0 in 0.373s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9860858-8ae2-4324-bc3d-a04c96a40f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00eefa04-11bd-489d-88ba-361e2b31cf14', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ff07b7-a5e0-4ed4-88ca-935448095228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Volume volume-00eefa04-11bd-489d-88ba-361e2b31cf14 (00eefa04-11bd-489d-88ba-361e2b31cf14): created successfully Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ff07b7-a5e0-4ed4-88ca-935448095228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (c32bc725-fc54-4b3f-af22-1e9567408f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-52b7d229-1691-4256-b51a-8a62dc4d6f95 tempest-VolumesGetTest-879070351 None] Created volume successfully. Nov 02 14:31:17 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (ebce344a-493f-42b4-a153-fb0b10250cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd581e1f-7594-4e49-8e06-e052af7659a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd581e1f-7594-4e49-8e06-e052af7659a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1001047784',display_name='tempest-VolumesGetTest-Volume-114994685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e447805c-0752-41e5-821d-5c1df4dded1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:18Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5953d7ec-a572-48bf-a145-9cc4b1e20142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5953d7ec-a572-48bf-a145-9cc4b1e20142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12147f64-308b-488e-b1f0-190d11b36fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12147f64-308b-488e-b1f0-190d11b36fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e447805c-0752-41e5-821d-5c1df4dded1e', 'volume_name': 'volume-e447805c-0752-41e5-821d-5c1df4dded1e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfa2a93-0eee-49ab-b782-d777bc1ab3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dfa2a93-0eee-49ab-b782-d777bc1ab3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9518f5-0532-4875-a4ef-c9db293d05d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Volume e447805c-0752-41e5-821d-5c1df4dded1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e447805c-0752-41e5-821d-5c1df4dded1e', 'volume_size': 1} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1001047784',display_name='tempest-VolumesGetTest-Volume-114994685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e447805c-0752-41e5-821d-5c1df4dded1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:18Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Creating volume e447805c-0752-41e5-821d-5c1df4dded1e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:18 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:18 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e 1073741824 Nov 02 14:31:18 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:18 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e 1073741824" returned: 0 in 0.605s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:18 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e Nov 02 14:31:18 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:19 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e" returned: 0 in 0.286s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9518f5-0532-4875-a4ef-c9db293d05d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e447805c-0752-41e5-821d-5c1df4dded1e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c1f382-ef25-406c-9403-98b01fe23db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Volume volume-e447805c-0752-41e5-821d-5c1df4dded1e (e447805c-0752-41e5-821d-5c1df4dded1e): created successfully Nov 02 14:31:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c1f382-ef25-406c-9403-98b01fe23db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (ebce344a-493f-42b4-a153-fb0b10250cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-dc1faead-1a79-4932-a308-4185bc258a34 tempest-VolumesGetTest-879070351 None] Created volume successfully. Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-e447805c-0752-41e5-821d-5c1df4dded1e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Lock "cinder-e447805c-0752-41e5-821d-5c1df4dded1e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-e447805c-0752-41e5-821d-5c1df4dded1e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-e447805c-0752-41e5-821d-5c1df4dded1e" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1efbe9-0f46-47fd-a9ac-e47b09182195]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:20 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e Nov 02 14:31:20 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:20 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e" returned: 0 in 0.489s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:20 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e Nov 02 14:31:20 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:21 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e447805c-0752-41e5-821d-5c1df4dded1e" returned: 0 in 0.308s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-e447805c-0752-41e5-821d-5c1df4dded1e" released by "delete_volume" :: held 0.850s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Created reservations ['8c4d0f26-26ea-4da5-ad2c-00847b13b1bc', '518e03e7-5dc0-4a56-9737-3b52b636178d', '472def4f-b37a-47ec-a9cb-4061339cbe4b', '41d12911-1380-4453-ad6a-fdc45a50d65d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:21 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:21 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:21 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.289s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Deleted volume successfully. Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-00eefa04-11bd-489d-88ba-361e2b31cf14-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f8ccfd2a-a36e-4c92-850c-b9c60d5f4bbc tempest-VolumesGetTest-879070351 None] Lock "cinder-e447805c-0752-41e5-821d-5c1df4dded1e-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Lock "cinder-00eefa04-11bd-489d-88ba-361e2b31cf14-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-00eefa04-11bd-489d-88ba-361e2b31cf14" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-00eefa04-11bd-489d-88ba-361e2b31cf14" acquired by "delete_volume" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbc8cce-7ba9-4252-87fc-cb3e1b9ccc4d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:22 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 Nov 02 14:31:22 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:22 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14" returned: 0 in 0.467s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:22 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14 Nov 02 14:31:22 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:22 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-00eefa04-11bd-489d-88ba-361e2b31cf14" returned: 0 in 0.379s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-00eefa04-11bd-489d-88ba-361e2b31cf14" released by "delete_volume" :: held 0.927s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Created reservations ['8d3fda39-d011-4ef7-b821-b853f59db1f1', 'f06bdd0b-28a3-4cc4-a37b-52a8e62a9077', '8c5d8b67-9637-40aa-9319-c06c7e166622', '31c576fb-a0b9-4ba7-9f80-94a786556e63'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:23 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:23 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:23 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.533s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Deleted volume successfully. Nov 02 14:31:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5fc7bd4a-caf9-46dc-b61c-43d33641f64e tempest-VolumesGetTest-879070351 None] Lock "cinder-00eefa04-11bd-489d-88ba-361e2b31cf14-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Flow 'volume_create_manager' (a6ae48bc-fc6f-46ba-9e6f-711625218669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2ee16c-6e2a-402d-9c8c-8a73cd84d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2ee16c-6e2a-402d-9c8c-8a73cd84d328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-473131293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae48888d-769d-4885-b010-637fc0db1304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b52676645495c8ce9d2d6f6999c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:24Z,use_quota=True,user_id='372acfde08c04c2bb2da9360c16690e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7da5ab-3d4d-456e-8b78-e12d1b452d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7da5ab-3d4d-456e-8b78-e12d1b452d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1d48b2-1841-4d7d-9fb4-e96605c149e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1d48b2-1841-4d7d-9fb4-e96605c149e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae48888d-769d-4885-b010-637fc0db1304', 'volume_name': 'volume-ae48888d-769d-4885-b010-637fc0db1304', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14032600-6306-42ce-bf2f-aa27e3941432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14032600-6306-42ce-bf2f-aa27e3941432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858746db-e653-421e-bc72-a7011c96d73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Volume ae48888d-769d-4885-b010-637fc0db1304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae48888d-769d-4885-b010-637fc0db1304', 'volume_size': 1} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-473131293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae48888d-769d-4885-b010-637fc0db1304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b52676645495c8ce9d2d6f6999c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:24Z,use_quota=True,user_id='372acfde08c04c2bb2da9360c16690e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Creating volume ae48888d-769d-4885-b010-637fc0db1304 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:24 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:24 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 1073741824 Nov 02 14:31:24 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (79474ade-3ed4-4872-9f65-b4036f59cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b771f3-30f5-4fab-a435-1ff00fffb112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b771f3-30f5-4fab-a435-1ff00fffb112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-234807228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:24Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770c2f68-0abc-44ae-9386-4442b6be4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770c2f68-0abc-44ae-9386-4442b6be4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b165757-a706-41f9-a982-7a287df04512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b165757-a706-41f9-a982-7a287df04512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4', 'volume_name': 'volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f15b6da-8940-4e07-8fb6-380f30cc7978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f15b6da-8940-4e07-8fb6-380f30cc7978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7254ed-4453-4611-9d8b-7dd18e336253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:24 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Volume 6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4', 'volume_size': 1} Nov 02 14:31:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:25 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 1073741824" returned: 0 in 0.667s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:25 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 Nov 02 14:31:25 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:25 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304" returned: 0 in 0.307s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-234807228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:24Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Creating volume 6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:25 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858746db-e653-421e-bc72-a7011c96d73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae48888d-769d-4885-b010-637fc0db1304', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:25 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 1073741824 Nov 02 14:31:25 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b088d5ef-9330-4753-8885-f77f0273e410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:25 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Volume volume-ae48888d-769d-4885-b010-637fc0db1304 (ae48888d-769d-4885-b010-637fc0db1304): created successfully Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b088d5ef-9330-4753-8885-f77f0273e410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Flow 'volume_create_manager' (a6ae48bc-fc6f-46ba-9e6f-711625218669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1611857e-ce3d-4160-99d5-f2de7b332467 tempest-VolumesListAdminTestJSON-2123967207 None] Created volume successfully. Nov 02 14:31:25 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 1073741824" returned: 0 in 0.589s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:26 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 Nov 02 14:31:26 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:26 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7254ed-4453-4611-9d8b-7dd18e336253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d0f913-a7c2-4011-9f8a-12f96815063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:26 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Volume volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 (6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4): created successfully Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d0f913-a7c2-4011-9f8a-12f96815063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (79474ade-3ed4-4872-9f65-b4036f59cdce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-26731c6e-a036-4cee-9435-b76740c93c12 tempest-VolumesGetTest-879070351 None] Created volume successfully. Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Flow 'volume_create_manager' (a2304adf-27ff-4369-ba81-a05710a67752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e5ce92-916c-4997-a0db-070d0ac84659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e5ce92-916c-4997-a0db-070d0ac84659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-303149462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef03b20-a3d1-425f-bc51-14aa5b7ac105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b52676645495c8ce9d2d6f6999c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:27Z,use_quota=True,user_id='372acfde08c04c2bb2da9360c16690e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7341ab3-8daa-4567-93aa-d5ab0c56f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7341ab3-8daa-4567-93aa-d5ab0c56f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31632a4b-0dbd-4d87-ba72-094a5303dead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31632a4b-0dbd-4d87-ba72-094a5303dead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef03b20-a3d1-425f-bc51-14aa5b7ac105', 'volume_name': 'volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f35be9-2351-4093-9a2c-9255b43df067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f35be9-2351-4093-9a2c-9255b43df067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8c8b93-ddcf-43e1-9709-c867c087e716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:26 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Volume 1ef03b20-a3d1-425f-bc51-14aa5b7ac105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105', 'volume_size': 1} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-303149462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef03b20-a3d1-425f-bc51-14aa5b7ac105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b52676645495c8ce9d2d6f6999c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:27Z,use_quota=True,user_id='372acfde08c04c2bb2da9360c16690e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Creating volume 1ef03b20-a3d1-425f-bc51-14aa5b7ac105 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:26 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:26 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 1073741824 Nov 02 14:31:26 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:27 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 1073741824" returned: 0 in 0.491s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:27 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 Nov 02 14:31:27 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:27 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8c8b93-ddcf-43e1-9709-c867c087e716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1f2927-ede9-409a-8256-9f53922a89f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Volume volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 (1ef03b20-a3d1-425f-bc51-14aa5b7ac105): created successfully Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1f2927-ede9-409a-8256-9f53922a89f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Flow 'volume_create_manager' (a2304adf-27ff-4369-ba81-a05710a67752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:27 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f6b6b666-1f38-48e2-a858-39042c7c4e1e tempest-VolumesListAdminTestJSON-2123967207 None] Created volume successfully. Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (fefacf1f-101a-4e77-bddb-186e2341353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb7be2a-bb84-4a15-a9e0-5b5dfb7ec55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb7be2a-bb84-4a15-a9e0-5b5dfb7ec55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-61454554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f019a3-a648-4e96-9c73-3f23a79eb2c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:28Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cc64ae-42e2-41d5-ae4d-f1f0d37d0746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cc64ae-42e2-41d5-ae4d-f1f0d37d0746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd6cf6e-9a73-4f6a-909e-e30a411d9c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd6cf6e-9a73-4f6a-909e-e30a411d9c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '27f019a3-a648-4e96-9c73-3f23a79eb2c0', 'volume_name': 'volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0', 'volume_size': 1, 'source_volid': '6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4', 'source_volstatus': 'available'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8691e289-e149-4b38-8724-33360e3750ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8691e289-e149-4b38-8724-33360e3750ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79262751-8563-49e9-8e09-ab2ba02e16c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Volume 27f019a3-a648-4e96-9c73-3f23a79eb2c0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0', 'volume_size': 1, 'source_volid': '6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4', 'source_volstatus': 'available'} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:27 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Cloning volume 6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 to volume 27f019a3-a648-4e96-9c73-3f23a79eb2c0 Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Creating offline snapshot 183191ba-d347-4a89-a130-92e773f203b2 of volume 6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ad5f29-ef4d-4225-ab12-f2e0a769991f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:27 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 Nov 02 14:31:27 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:28 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" returned: 0 in 0.385s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:28 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 1G Nov 02 14:31:28 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:28 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 1G" returned: 0 in 0.502s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:28 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 Nov 02 14:31:28 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:29 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2" returned: 0 in 0.385s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:29 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 is being set with open permissions: ugo+rw Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:29 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 Nov 02 14:31:29 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Flow 'volume_create_manager' (92faf220-e9dc-4b6c-88df-53a8b0cdbd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5874ab76-3abe-437b-9c37-4cdf05a26976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5874ab76-3abe-437b-9c37-4cdf05a26976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1320722137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5326bc9a-c3a9-42ef-ab3d-b153b5738536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b52676645495c8ce9d2d6f6999c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:29Z,use_quota=True,user_id='372acfde08c04c2bb2da9360c16690e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641d8e2b-999b-446c-a620-2499487baab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641d8e2b-999b-446c-a620-2499487baab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8b6bf4-235c-4746-bb55-1da8b9482142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8b6bf4-235c-4746-bb55-1da8b9482142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5326bc9a-c3a9-42ef-ab3d-b153b5738536', 'volume_name': 'volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e5cbbd-cacc-4e27-b927-6428941e7a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e5cbbd-cacc-4e27-b927-6428941e7a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919e31f8-a0bc-44fa-bdf8-48f8db9a09c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:29 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Volume 5326bc9a-c3a9-42ef-ab3d-b153b5738536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536', 'volume_size': 1} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:29 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2" returned: 0 in 0.294s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:29 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.info Nov 02 14:31:29 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:29 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.info" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:29 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.info is being set with open permissions: ugo+rw Nov 02 14:31:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:29 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.info Nov 02 14:31:29 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:30 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.info" returned: 0 in 0.264s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-27f019a3-a648-4e96-9c73-3f23a79eb2c0" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-27f019a3-a648-4e96-9c73-3f23a79eb2c0" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] snapshot: 183191ba-d347-4a89-a130-92e773f203b2, volume: 27f019a3-a648-4e96-9c73-3f23a79eb2c0, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be7eb7c-836d-46f6-93e9-e11c19774f14]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:30 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 Nov 02 14:31:30 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:30 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d999a3ed-e644-46da-b9cb-84f569e47d68]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:30 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 Nov 02 14:31:30 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:30 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" returned: 0 in 0.380s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:31:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:30 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 Nov 02 14:31:30 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:39 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:39 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=97,cinder:SELECT=65,cinder:DELETE=8,cinder:INSERT=14 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=73,cinder:INSERT=27,cinder:UPDATE=87,cinder:DELETE=10 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:31:39 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.562s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:31:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:31:40 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0" returned: 0 in 9.233s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4, size 1024.00 MB, duration 9.24 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:31:40 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Converted 1024.00 MB image at 110.87 MB/s Nov 02 14:31:40 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 is being set with open permissions: ugo+rw Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:40 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 Nov 02 14:31:40 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:40 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0" returned: 0 in 0.344s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-27f019a3-a648-4e96-9c73-3f23a79eb2c0" released by "_copy_volume_from_snapshot" :: held 10.425s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-183191ba-d347-4a89-a130-92e773f203b2" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-183191ba-d347-4a89-a130-92e773f203b2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Deleting offline snapshot 183191ba-d347-4a89-a130-92e773f203b2 of volume 6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] snapshot_file for this snap is: volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a890a-2ac7-4716-9ff0-80d74307db26]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:40 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-c6f4ee93-3f80-4b68-8883-918c0a85ab26 req-3def9c82-7d57-455c-9379-aee896a768d6 tempest-TestMinimumBasicScenario-321965529 None] Terminate volume connection completed successfully. Nov 02 14:31:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-c6f4ee93-3f80-4b68-8883-918c0a85ab26 req-3def9c82-7d57-455c-9379-aee896a768d6 tempest-TestMinimumBasicScenario-321965529 None] Deleting attachment 4f0a2003-9cda-4362-9f6f-e563aabfb231. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:31:40 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 Nov 02 14:31:40 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:41 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2" returned: 0 in 0.466s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3777f7c-29ae-4f8e-8316-1cf4baea1a49]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:41 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 Nov 02 14:31:41 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Acquiring lock "cinder-3f01d674-e2db-4b26-9282-a82ff97ab7d3-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Lock "cinder-3f01d674-e2db-4b26-9282-a82ff97ab7d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Acquiring lock "cinder-quobyte-3f01d674-e2db-4b26-9282-a82ff97ab7d3" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Lock "cinder-quobyte-3f01d674-e2db-4b26-9282-a82ff97ab7d3" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fcbdc0-162d-4380-ac7d-fcf54d868eeb]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:41 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" returned: 0 in 0.653s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:41 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 Nov 02 14:31:41 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:41 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 Nov 02 14:31:41 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:42 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3" returned: 0 in 0.414s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:42 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3 Nov 02 14:31:42 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:42 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:42 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2 Nov 02 14:31:42 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:42 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3f01d674-e2db-4b26-9282-a82ff97ab7d3" returned: 0 in 0.292s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Lock "cinder-quobyte-3f01d674-e2db-4b26-9282-a82ff97ab7d3" released by "delete_volume" :: held 0.757s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Created reservations ['cd212b1d-df20-4b0b-bb0b-3e5046ade299', '53c664b2-98be-4c39-9696-4b85c8560cf6', 'd3ddcb7e-724f-4294-a1a7-8e625b21c484', '4dc7fb7e-c77f-4c9e-9e48-63cc8c41c1cc'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:42 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4.183191ba-d347-4a89-a130-92e773f203b2" returned: 0 in 0.299s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-183191ba-d347-4a89-a130-92e773f203b2" released by "_delete_snapshot" :: held 1.953s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.682s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.145s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1320722137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5326bc9a-c3a9-42ef-ab3d-b153b5738536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b52676645495c8ce9d2d6f6999c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:29Z,use_quota=True,user_id='372acfde08c04c2bb2da9360c16690e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Creating volume 5326bc9a-c3a9-42ef-ab3d-b153b5738536 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:42 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:42 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 1073741824 Nov 02 14:31:42 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79262751-8563-49e9-8e09-ab2ba02e16c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0', 'volume_size': 1, 'source_volid': '6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4', 'source_volstatus': 'available'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:42 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:42 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a1de5c-c8ae-4bcb-b170-87f3252720f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Volume volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 (27f019a3-a648-4e96-9c73-3f23a79eb2c0): created successfully Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a1de5c-c8ae-4bcb-b170-87f3252720f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (fefacf1f-101a-4e77-bddb-186e2341353d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-79df79fd-0119-4089-bb2c-fc5494ee30b5 tempest-VolumesGetTest-879070351 None] Created volume successfully. Nov 02 14:31:43 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.534s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:43 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Deleted volume successfully. Nov 02 14:31:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b8af3cc2-be3e-4fa2-aab8-454d03e7e094 tempest-TestMinimumBasicScenario-321965529 None] Lock "cinder-3f01d674-e2db-4b26-9282-a82ff97ab7d3-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:43 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 1073741824" returned: 0 in 0.936s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:43 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 Nov 02 14:31:43 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:44 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536" returned: 0 in 0.444s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919e31f8-a0bc-44fa-bdf8-48f8db9a09c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c39794-2ac1-46d3-bb51-cd7bd4c3fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Volume volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 (5326bc9a-c3a9-42ef-ab3d-b153b5738536): created successfully Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c39794-2ac1-46d3-bb51-cd7bd4c3fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Flow 'volume_create_manager' (92faf220-e9dc-4b6c-88df-53a8b0cdbd74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2edce1db-86bc-42c1-a719-7d3101cab882 tempest-VolumesListAdminTestJSON-2123967207 None] Created volume successfully. Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (5d754714-eaaf-4bbe-927a-4f516974e6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad62cf-964b-4032-8d21-b93d6b236c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad62cf-964b-4032-8d21-b93d6b236c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1974948084',display_name='tempest-VolumesGetTest-Volume-1336331948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09035a75-8ed7-4224-a6e0-6b2282bfbfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:44Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6ab83f-e75d-4d3b-a47c-bbcd8cb1e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6ab83f-e75d-4d3b-a47c-bbcd8cb1e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ced582a-3004-4053-a248-007597db5ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ced582a-3004-4053-a248-007597db5ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09035a75-8ed7-4224-a6e0-6b2282bfbfb7', 'volume_name': 'volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecbabf4-c5c8-4496-b442-734f3be6bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecbabf4-c5c8-4496-b442-734f3be6bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c640067-d119-4766-82ad-3b4f38a02144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Volume 09035a75-8ed7-4224-a6e0-6b2282bfbfb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7', 'volume_size': 1} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1974948084',display_name='tempest-VolumesGetTest-Volume-1336331948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09035a75-8ed7-4224-a6e0-6b2282bfbfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:44Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Creating volume 09035a75-8ed7-4224-a6e0-6b2282bfbfb7 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:44 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:44 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 1073741824 Nov 02 14:31:44 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:45 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 1073741824" returned: 0 in 0.644s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:45 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 Nov 02 14:31:45 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:45 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c640067-d119-4766-82ad-3b4f38a02144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96f245d-2281-4cb2-8461-7d816989888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Volume volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 (09035a75-8ed7-4224-a6e0-6b2282bfbfb7): created successfully Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96f245d-2281-4cb2-8461-7d816989888b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (5d754714-eaaf-4bbe-927a-4f516974e6c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b82312c2-6160-4a2e-bede-28a8d29755a2 tempest-VolumesGetTest-879070351 None] Created volume successfully. Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Flow 'volume_create_manager' (ceeec21c-4bf1-4238-9333-a7f4fb3691c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb74d9d3-88b1-4334-a53e-f69254afc3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb74d9d3-88b1-4334-a53e-f69254afc3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4caf14-e23a-4cfb-9a37-3491ba158f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc5a41d23d24fca830c6dcc13713bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:46Z,use_quota=True,user_id='f2543da2a45a4e2fa4dd5e671683bb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0987367e-08a9-4994-aa8a-4a4f37ef621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0987367e-08a9-4994-aa8a-4a4f37ef621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c401ef0-166a-48da-8b94-8432c4669dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c401ef0-166a-48da-8b94-8432c4669dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4caf14-e23a-4cfb-9a37-3491ba158f91', 'volume_name': 'volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cfd6df-19d3-4693-801c-5ba99bb94608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66cfd6df-19d3-4693-801c-5ba99bb94608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4deb11c6-4dbc-4033-8709-0acd10ade818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Volume 1f4caf14-e23a-4cfb-9a37-3491ba158f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91', 'volume_size': 1} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4caf14-e23a-4cfb-9a37-3491ba158f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc5a41d23d24fca830c6dcc13713bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:46Z,use_quota=True,user_id='f2543da2a45a4e2fa4dd5e671683bb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Creating volume 1f4caf14-e23a-4cfb-9a37-3491ba158f91 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:45 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:45 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 1073741824 Nov 02 14:31:45 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:46 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 1073741824" returned: 0 in 0.639s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:46 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 Nov 02 14:31:46 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-09035a75-8ed7-4224-a6e0-6b2282bfbfb7-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Lock "cinder-09035a75-8ed7-4224-a6e0-6b2282bfbfb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-09035a75-8ed7-4224-a6e0-6b2282bfbfb7" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-09035a75-8ed7-4224-a6e0-6b2282bfbfb7" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3698e808-167b-4400-969a-5b0c21d38c0e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:46 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91" returned: 0 in 0.409s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4deb11c6-4dbc-4033-8709-0acd10ade818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac0a8f3-875d-4975-a72f-38a38f2265de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:46 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 Nov 02 14:31:46 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:46 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Volume volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 (1f4caf14-e23a-4cfb-9a37-3491ba158f91): created successfully Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac0a8f3-875d-4975-a72f-38a38f2265de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Flow 'volume_create_manager' (ceeec21c-4bf1-4238-9333-a7f4fb3691c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9d129b5e-1d09-4226-9467-cc0d8402a8e1 tempest-VolumesListAdminTestJSON-1695856864 None] Created volume successfully. Nov 02 14:31:47 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7" returned: 0 in 0.478s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:47 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7 Nov 02 14:31:47 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:47 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09035a75-8ed7-4224-a6e0-6b2282bfbfb7" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-09035a75-8ed7-4224-a6e0-6b2282bfbfb7" released by "delete_volume" :: held 0.839s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Created reservations ['a5221f2a-2681-4491-ba3a-2d2402db0943', '6a40a301-56cd-4580-bbd8-d4befe02e663', '3be64a34-23a4-4e30-a0cf-f4f5fcf7a6e0', '452c8f76-7ffa-411f-af59-346a3525ca0b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:47 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:47 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-27f019a3-a648-4e96-9c73-3f23a79eb2c0-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Acquiring lock "cinder-1f4caf14-e23a-4cfb-9a37-3491ba158f91-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Lock "cinder-27f019a3-a648-4e96-9c73-3f23a79eb2c0-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Lock "cinder-1f4caf14-e23a-4cfb-9a37-3491ba158f91-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-27f019a3-a648-4e96-9c73-3f23a79eb2c0" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Acquiring lock "cinder-quobyte-1f4caf14-e23a-4cfb-9a37-3491ba158f91" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-27f019a3-a648-4e96-9c73-3f23a79eb2c0" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Lock "cinder-quobyte-1f4caf14-e23a-4cfb-9a37-3491ba158f91" acquired by "delete_volume" :: waited 0.042s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da8b97-2553-49fb-88c9-5d57c00175c5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:48 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "cinder-5326bc9a-c3a9-42ef-ab3d-b153b5738536-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.570s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ab8e0-2db3-41cc-8d2b-5d442e59f9e5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Deleted volume successfully. Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-5326bc9a-c3a9-42ef-ab3d-b153b5738536-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5330c304-d50b-4b61-aea2-1dad415c864e tempest-VolumesGetTest-879070351 None] Lock "cinder-09035a75-8ed7-4224-a6e0-6b2282bfbfb7-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "cinder-quobyte-5326bc9a-c3a9-42ef-ab3d-b153b5738536" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:48 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 Nov 02 14:31:48 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-quobyte-5326bc9a-c3a9-42ef-ab3d-b153b5738536" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b1df9a-0eac-45c1-80d4-3a3004598927]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:48 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 Nov 02 14:31:48 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:48 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 Nov 02 14:31:48 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:48 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0" returned: 0 in 0.516s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:48 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0 Nov 02 14:31:48 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:49 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91" returned: 0 in 0.787s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:49 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91 Nov 02 14:31:49 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:49 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-27f019a3-a648-4e96-9c73-3f23a79eb2c0" returned: 0 in 0.386s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:49 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536" returned: 0 in 0.695s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-27f019a3-a648-4e96-9c73-3f23a79eb2c0" released by "delete_volume" :: held 1.001s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:49 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536 Nov 02 14:31:49 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Created reservations ['6de2b540-5a67-45ec-b5dc-1054d9d5ef5b', '6d43505d-7760-485d-afd4-6dfb8bc218c2', 'c8944052-ce40-496b-b084-00084a30102c', '11bd4ffd-bd16-461b-a693-2f0dfe8806c8'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:49 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:49 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:49 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1f4caf14-e23a-4cfb-9a37-3491ba158f91" returned: 0 in 0.457s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Lock "cinder-quobyte-1f4caf14-e23a-4cfb-9a37-3491ba158f91" released by "delete_volume" :: held 1.347s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:49 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5326bc9a-c3a9-42ef-ab3d-b153b5738536" returned: 0 in 0.455s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-quobyte-5326bc9a-c3a9-42ef-ab3d-b153b5738536" released by "delete_volume" :: held 1.231s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Created reservations ['a9e9b66a-b4df-4c71-9de4-cced55b129db', '7ba0b3bf-f0d5-4350-b09f-f7e2247b698a', 'ed1a4a26-c411-49cd-bf28-74831d7f8789', '5365c2ae-677e-439e-8258-05ae8f62a2ae'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:49 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.318s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Deleted volume successfully. Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1641c23d-c1a1-4164-8911-b4980b6e8fed tempest-VolumesGetTest-879070351 None] Lock "cinder-27f019a3-a648-4e96-9c73-3f23a79eb2c0-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Created reservations ['d425051f-bb2d-4bf6-ba52-dd63eb5931e2', '66daa994-6978-4561-88fe-3c9e679a3758', 'df8cec97-89f1-469e-a371-cf8bc8feb246', 'a9d499ea-98cb-4005-a13c-c68367a71066'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:49 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:49 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:50 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:50 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:50 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.366s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Deleted volume successfully. Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4482c3f5-69f4-4cdb-8fa7-d24e957f15ae tempest-VolumesListAdminTestJSON-1695856864 None] Lock "cinder-1f4caf14-e23a-4cfb-9a37-3491ba158f91-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:50 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.301s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Deleted volume successfully. Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a6981de-dc0a-4426-bca9-f448f855682a tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-5326bc9a-c3a9-42ef-ab3d-b153b5738536-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Lock "cinder-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea74adc2-eb41-41c8-aa69-8eeefa46d5f0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "cinder-1ef03b20-a3d1-425f-bc51-14aa5b7ac105-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-1ef03b20-a3d1-425f-bc51-14aa5b7ac105-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "cinder-quobyte-1ef03b20-a3d1-425f-bc51-14aa5b7ac105" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-quobyte-1ef03b20-a3d1-425f-bc51-14aa5b7ac105" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:50 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 Nov 02 14:31:50 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfec5c3-e011-47ac-8b03-d39d8cbd5352]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:51 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 Nov 02 14:31:51 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:51 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" returned: 0 in 0.626s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:51 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4 Nov 02 14:31:51 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:51 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105" returned: 0 in 0.506s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:51 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105 Nov 02 14:31:51 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:51 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" returned: 0 in 0.356s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4" released by "delete_volume" :: held 1.104s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Created reservations ['72fab5f0-322a-431d-b1da-e95946d3be5e', '88f32445-d988-4b63-9af5-85f206d88362', '2a26195e-99df-437f-a02f-afa215659f0b', '601fd82d-d353-4292-8ef6-1370f8b96625'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:51 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1ef03b20-a3d1-425f-bc51-14aa5b7ac105" returned: 0 in 0.367s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-quobyte-1ef03b20-a3d1-425f-bc51-14aa5b7ac105" released by "delete_volume" :: held 0.947s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:51 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Created reservations ['2d467086-140a-4243-8e87-3fec32b74649', '3b3d1e54-f303-47a5-9a74-54c36d08a214', 'f89e43d6-7036-43f5-84ff-e64807e09b45', 'd2ca693d-490b-4b54-98f7-d82d5e69755c'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:51 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:51 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:52 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:52 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:52 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.331s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Deleted volume successfully. Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f33acc8-abf0-495d-af2e-61c04f511360 tempest-VolumesGetTest-879070351 None] Lock "cinder-6bbb4833-5feb-4fb2-8231-d18e1cd5ecf4-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:52 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Deleted volume successfully. Nov 02 14:31:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c3e9b1ea-42f4-4f1c-80b3-fbd868e1c3fc tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-1ef03b20-a3d1-425f-bc51-14aa5b7ac105-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "cinder-ae48888d-769d-4885-b010-637fc0db1304-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-ae48888d-769d-4885-b010-637fc0db1304-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "cinder-quobyte-ae48888d-769d-4885-b010-637fc0db1304" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:31:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-quobyte-ae48888d-769d-4885-b010-637fc0db1304" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:31:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130d49c-8cdf-4c0d-af37-a5e73660a183]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:53 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 Nov 02 14:31:53 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:54 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304" returned: 0 in 0.583s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:54 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304 Nov 02 14:31:54 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:54 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae48888d-769d-4885-b010-637fc0db1304" returned: 0 in 0.364s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-quobyte-ae48888d-769d-4885-b010-637fc0db1304" released by "delete_volume" :: held 1.060s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Created reservations ['63807134-9033-4b90-8470-6e05bfee2c3a', 'ffb3ffdd-7120-4476-b701-a51560039903', '23f9ecdd-b9a1-4d09-8304-ff43ff021283', '33831330-57dc-433e-8b17-be4d23ced7f7'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:54 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:31:54 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (fd929cee-b89d-448f-babf-87f3ad9496f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96e666f-c7a9-46f5-b709-7b608ccb6880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96e666f-c7a9-46f5-b709-7b608ccb6880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1136172291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf78224d-4146-4c2e-a92c-289e75551b7d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:55Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99723da-5e29-46c1-bd2b-f26912107260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99723da-5e29-46c1-bd2b-f26912107260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39be992-b76f-45fc-abc1-6b2d027db79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:31:55 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:31:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Deleted volume successfully. Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-14e08a32-766d-4ccc-8096-50cc048292ad tempest-VolumesListAdminTestJSON-2123967207 None] Lock "cinder-ae48888d-769d-4885-b010-637fc0db1304-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39be992-b76f-45fc-abc1-6b2d027db79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf78224d-4146-4c2e-a92c-289e75551b7d', 'volume_name': 'volume-bf78224d-4146-4c2e-a92c-289e75551b7d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213826a1-7870-4e7e-947b-fa63f9ab36a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213826a1-7870-4e7e-947b-fa63f9ab36a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d9a42e-1793-442e-aee2-c366629d4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:31:55 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Volume bf78224d-4146-4c2e-a92c-289e75551b7d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf78224d-4146-4c2e-a92c-289e75551b7d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 14:31:55 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Trying to clone bf78224d-4146-4c2e-a92c-289e75551b7d from image 038a1496-6584-48e7-a7a3-32931ae28302 at location (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:31:56 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:31:56 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Image download 20.69 MB at 20.69 MB/s Nov 02 14:31:56 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a51592-2c6b-4ef1-8eea-8494c9e711e0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:56 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD Nov 02 14:31:56 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:56 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:56 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 is fetched for user 7fba0e13c9794b8a89f1b2ea448f84b5. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:31:56 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1a87fd-1ff1-4776-b335-519c032b15eb]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:56 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD Nov 02 14:31:56 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:57 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1136172291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf78224d-4146-4c2e-a92c-289e75551b7d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:31:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:31:55Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Creating volume bf78224d-4146-4c2e-a92c-289e75551b7d {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:31:57 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:57 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d 1073741824 Nov 02 14:31:57 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:57 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d 1073741824" returned: 0 in 0.521s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:57 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d Nov 02 14:31:57 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:57 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d" returned: 0 in 0.340s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:31:57 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Attempting download of 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume bf78224d-4146-4c2e-a92c-289e75551b7d. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5871ebad-5867-45a7-a668-3bc77bbb01e4]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_ywo9slqc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:58 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_ywo9slqc Nov 02 14:31:58 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:58 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_ywo9slqc" returned: 0 in 0.342s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_ywo9slqc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:58 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_ywo9slqc Nov 02 14:31:58 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:58 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_ywo9slqc" returned: 1 in 0.334s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_ywo9slqc' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ed4b60-059b-401f-a9c7-bfb5e72c3357]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:31:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:58 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD Nov 02 14:31:58 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:31:59 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 02 14:31:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:31:59 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] 038a1496-6584-48e7-a7a3-32931ae28302 was qcow2, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:31:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:31:59 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d Nov 02 14:31:59 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:02 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d" returned: 0 in 3.337s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:02 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_kp94zuvmdevstack@QuobyteHD, size 112.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:32:02 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Converted 112.00 MB image at 33.55 MB/s Nov 02 14:32:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:02 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d 1G Nov 02 14:32:02 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:02 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d 1G" returned: 0 in 0.478s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Downloaded image 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume bf78224d-4146-4c2e-a92c-289e75551b7d successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 for user 7fba0e13c9794b8a89f1b2ea448f84b5 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Marking volume bf78224d-4146-4c2e-a92c-289e75551b7d as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Copying metadata from image 038a1496-6584-48e7-a7a3-32931ae28302 to bf78224d-4146-4c2e-a92c-289e75551b7d. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Creating volume glance metadata for volume bf78224d-4146-4c2e-a92c-289e75551b7d backed by image 038a1496-6584-48e7-a7a3-32931ae28302 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d9a42e-1793-442e-aee2-c366629d4c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf78224d-4146-4c2e-a92c-289e75551b7d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525c0935-fc36-4a1e-88b5-aabe54a3cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:03 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Volume volume-bf78224d-4146-4c2e-a92c-289e75551b7d (bf78224d-4146-4c2e-a92c-289e75551b7d): created successfully Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525c0935-fc36-4a1e-88b5-aabe54a3cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:03 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (fd929cee-b89d-448f-babf-87f3ad9496f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-fbb2e176-2bae-4b67-9953-85f1f5969afb tempest-VolumesGetTest-879070351 None] Created volume successfully. Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (b3e32f65-1c2e-4edf-885e-58f97247619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93a58dd-d19a-4f8d-9547-7a44574e26fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93a58dd-d19a-4f8d-9547-7a44574e26fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-615857859',display_name='tempest-VolumesGetTest-Volume-701459978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9a6353-9d32-469d-9864-3aabd5c60718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:05Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0330a7c6-7bd6-4488-9390-8828ae1b9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0330a7c6-7bd6-4488-9390-8828ae1b9107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66befa98-972e-4e87-9f31-2de0c893e248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66befa98-972e-4e87-9f31-2de0c893e248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9a6353-9d32-469d-9864-3aabd5c60718', 'volume_name': 'volume-1d9a6353-9d32-469d-9864-3aabd5c60718', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af9c3b2-6db9-48e7-8514-aacf95230462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af9c3b2-6db9-48e7-8514-aacf95230462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a045e728-abdb-4b09-9350-74f1428ed58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:04 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Volume 1d9a6353-9d32-469d-9864-3aabd5c60718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9a6353-9d32-469d-9864-3aabd5c60718', 'volume_size': 1} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-615857859',display_name='tempest-VolumesGetTest-Volume-701459978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9a6353-9d32-469d-9864-3aabd5c60718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730d4a610cc74c48bf9de0058e9a920b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:05Z,use_quota=True,user_id='7fba0e13c9794b8a89f1b2ea448f84b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Creating volume 1d9a6353-9d32-469d-9864-3aabd5c60718 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:04 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:04 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 1073741824 Nov 02 14:32:04 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (bc7fe3c3-50a4-47c0-9470-80732dccdfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a55a45e-39c5-4d39-8e20-546c2b0f534f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a55a45e-39c5-4d39-8e20-546c2b0f534f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025219639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1986d421-4e67-4e66-85f3-2439b0d19258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:05Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6822ff-9940-4b37-901f-aaeeec2ad840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6822ff-9940-4b37-901f-aaeeec2ad840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921746f9-1739-4ca8-b785-79ac83d99d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921746f9-1739-4ca8-b785-79ac83d99d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1986d421-4e67-4e66-85f3-2439b0d19258', 'volume_name': 'volume-1986d421-4e67-4e66-85f3-2439b0d19258', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3312c36d-2172-421a-8033-4324f35ad683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3312c36d-2172-421a-8033-4324f35ad683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24814ac7-8da3-4a2f-a6b4-b149dabe6c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Volume 1986d421-4e67-4e66-85f3-2439b0d19258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1986d421-4e67-4e66-85f3-2439b0d19258', 'volume_size': 1} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:05 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 1073741824" returned: 0 in 0.872s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Flow 'volume_create_manager' (24672071-2dcd-4797-95c0-6cfc062d7901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71abe492-bbce-42e6-8f37-fdd0241fc418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:05 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 Nov 02 14:32:05 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71abe492-bbce-42e6-8f37-fdd0241fc418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1564009599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de32dad-9000-46a4-8319-d84a700ad38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca8d0c9211c448ba3b28533b683b1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:06Z,use_quota=True,user_id='755aa4969d9246209f0eae4758cc0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf56267-efb2-4f66-9bd4-5538bf843e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cf56267-efb2-4f66-9bd4-5538bf843e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79862e0-5c0e-4ecf-b25a-49588ef7b536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:05 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:32:06 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718" returned: 0 in 0.293s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025219639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1986d421-4e67-4e66-85f3-2439b0d19258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:05Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Creating volume 1986d421-4e67-4e66-85f3-2439b0d19258 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:06 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a045e728-abdb-4b09-9350-74f1428ed58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9a6353-9d32-469d-9864-3aabd5c60718', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d25643-dd08-487f-a14b-7802e9f01a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:06 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 1073741824 Nov 02 14:32:06 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:06 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Volume volume-1d9a6353-9d32-469d-9864-3aabd5c60718 (1d9a6353-9d32-469d-9864-3aabd5c60718): created successfully Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d25643-dd08-487f-a14b-7802e9f01a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Flow 'volume_create_manager' (b3e32f65-1c2e-4edf-885e-58f97247619a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2d77cb5f-ae48-49cb-bbb4-7cfb94a67297 tempest-VolumesGetTest-879070351 None] Created volume successfully. Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c79862e0-5c0e-4ecf-b25a-49588ef7b536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3de32dad-9000-46a4-8319-d84a700ad38a', 'volume_name': 'volume-3de32dad-9000-46a4-8319-d84a700ad38a', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615f9dc2-6b11-4e5f-b615-8a69a05c31c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615f9dc2-6b11-4e5f-b615-8a69a05c31c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbcb8cd-8bce-4438-83c7-1dde0eda9e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:06 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Volume 3de32dad-9000-46a4-8319-d84a700ad38a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3de32dad-9000-46a4-8319-d84a700ad38a', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Trying to clone 3de32dad-9000-46a4-8319-d84a700ad38a from image 038a1496-6584-48e7-a7a3-32931ae28302 at location (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:32:06 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 1073741824" returned: 0 in 0.616s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:06 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 Nov 02 14:32:06 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:32:06 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Image download 20.69 MB at 20.69 MB/s Nov 02 14:32:06 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f80fb-e8b0-4b14-95d9-0f3669453812]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-1d9a6353-9d32-469d-9864-3aabd5c60718-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Lock "cinder-1d9a6353-9d32-469d-9864-3aabd5c60718-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:07 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD Nov 02 14:32:07 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:07 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258" returned: 0 in 0.375s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24814ac7-8da3-4a2f-a6b4-b149dabe6c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1986d421-4e67-4e66-85f3-2439b0d19258', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f3278-6dea-4357-9762-2f89c065301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-1d9a6353-9d32-469d-9864-3aabd5c60718" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-1d9a6353-9d32-469d-9864-3aabd5c60718" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:07 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Volume volume-1986d421-4e67-4e66-85f3-2439b0d19258 (1986d421-4e67-4e66-85f3-2439b0d19258): created successfully Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f3278-6dea-4357-9762-2f89c065301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (bc7fe3c3-50a4-47c0-9470-80732dccdfc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cfbb66-eed9-4325-aa06-1013de8c9d8e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:07 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d47a1934-bd62-4bdd-acaa-616285b80ac5 tempest-VolumesActionsTest-704982259 None] Created volume successfully. Nov 02 14:32:07 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 is fetched for user 755aa4969d9246209f0eae4758cc0717. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:32:07 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 Nov 02 14:32:07 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4de1796-c066-418a-af1b-0991b027b94d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:07 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD Nov 02 14:32:07 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:07 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718" returned: 0 in 0.514s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:08 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718 Nov 02 14:32:08 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:08 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1564009599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3de32dad-9000-46a4-8319-d84a700ad38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca8d0c9211c448ba3b28533b683b1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:06Z,use_quota=True,user_id='755aa4969d9246209f0eae4758cc0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Creating volume 3de32dad-9000-46a4-8319-d84a700ad38a {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:08 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:08 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 1073741824 Nov 02 14:32:08 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:08 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1d9a6353-9d32-469d-9864-3aabd5c60718" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-1d9a6353-9d32-469d-9864-3aabd5c60718" released by "delete_volume" :: held 0.871s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Created reservations ['1000d0ff-d9ff-45da-abea-85088f2d0693', 'd74a72e9-fca9-4e84-a7c9-27ab58948419', '2220ab81-6064-41ea-87fc-3f1a18f23d69', '294a1f04-f07f-4fa9-aa9d-5198d9f017e1'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:08 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:08 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-69397ed4-7515-4758-83c5-e0395f97f5a1 tempest-VolumesActionsTest-704982259 None] Acquiring lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258" by "attach_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-69397ed4-7515-4758-83c5-e0395f97f5a1 tempest-VolumesActionsTest-704982259 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258" acquired by "attach_volume" :: waited 0.038s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-69397ed4-7515-4758-83c5-e0395f97f5a1 tempest-VolumesActionsTest-704982259 None] Attaching volume 1986d421-4e67-4e66-85f3-2439b0d19258 to instance 6faef85a-5532-4114-ad66-7538c8ab3379 at mountpoint /dev/vdb on host None. Nov 02 14:32:08 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 1073741824" returned: 0 in 0.638s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-69397ed4-7515-4758-83c5-e0395f97f5a1 tempest-VolumesActionsTest-704982259 None] Attach volume completed successfully. Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-69397ed4-7515-4758-83c5-e0395f97f5a1 tempest-VolumesActionsTest-704982259 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258" released by "attach_volume" :: held 0.127s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:08 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a Nov 02 14:32:08 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:09 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.495s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Deleted volume successfully. Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-322dac37-164b-4c9f-bfe9-4fce8355d438 tempest-VolumesGetTest-879070351 None] Lock "cinder-1d9a6353-9d32-469d-9864-3aabd5c60718-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:09 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a" returned: 0 in 0.361s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Attempting download of 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume 3de32dad-9000-46a4-8319-d84a700ad38a. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b752827-bcda-4134-841a-56f134095a23]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tftl6_o8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:09 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tftl6_o8 Nov 02 14:32:09 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:09 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tftl6_o8" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tftl6_o8 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-bf78224d-4146-4c2e-a92c-289e75551b7d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Lock "cinder-bf78224d-4146-4c2e-a92c-289e75551b7d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Acquiring lock "cinder-quobyte-bf78224d-4146-4c2e-a92c-289e75551b7d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-bf78224d-4146-4c2e-a92c-289e75551b7d" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c37fe7-03fd-4f26-b889-e3721772dbb0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:09 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tftl6_o8 Nov 02 14:32:09 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:10 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8bdad038-2d88-4dc1-8dbc-3f33e0f40bda tempest-VolumesActionsTest-1603964918 None] Terminate volume connection completed successfully. Nov 02 14:32:10 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d Nov 02 14:32:10 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bdad038-2d88-4dc1-8dbc-3f33e0f40bda tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-detach_volume" by "detach_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bdad038-2d88-4dc1-8dbc-3f33e0f40bda tempest-VolumesActionsTest-1603964918 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:10 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8bdad038-2d88-4dc1-8dbc-3f33e0f40bda tempest-VolumesActionsTest-1603964918 None] Detaching volume 1986d421-4e67-4e66-85f3-2439b0d19258 from instance 6faef85a-5532-4114-ad66-7538c8ab3379. Nov 02 14:32:10 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8bdad038-2d88-4dc1-8dbc-3f33e0f40bda tempest-VolumesActionsTest-1603964918 None] Detach volume completed successfully. Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8bdad038-2d88-4dc1-8dbc-3f33e0f40bda tempest-VolumesActionsTest-1603964918 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:10 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tftl6_o8" returned: 1 in 0.704s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_tftl6_o8' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9501e1ce-feda-4c22-a25e-39507dc72483]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:10 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d" returned: 0 in 0.610s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3738b33-1289-494e-b4b4-291452ede1ef tempest-VolumesActionsTest-704982259 None] Acquiring lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-detach_volume" by "detach_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:10 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD Nov 02 14:32:10 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:10 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d Nov 02 14:32:10 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3738b33-1289-494e-b4b4-291452ede1ef tempest-VolumesActionsTest-704982259 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:10 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d3738b33-1289-494e-b4b4-291452ede1ef tempest-VolumesActionsTest-704982259 None] Volume detach called, but volume not attached. Nov 02 14:32:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3738b33-1289-494e-b4b4-291452ede1ef tempest-VolumesActionsTest-704982259 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:11 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD" returned: 0 in 0.650s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] 038a1496-6584-48e7-a7a3-32931ae28302 was qcow2, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Acquiring lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:11 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:11 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bf78224d-4146-4c2e-a92c-289e75551b7d" returned: 0 in 0.664s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:11 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Lock "cinder-quobyte-bf78224d-4146-4c2e-a92c-289e75551b7d" released by "delete_volume" :: held 1.350s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Acquiring lock "cinder-quobyte-1986d421-4e67-4e66-85f3-2439b0d19258" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Lock "cinder-quobyte-1986d421-4e67-4e66-85f3-2439b0d19258" acquired by "delete_volume" :: waited 0.051s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Created reservations ['6333662b-5ef5-4fdc-83e4-7caa754bd424', '69566028-0b96-4aba-8674-3993b59d791a', 'c629b48a-ce26-4633-95c3-ec9f16a02852', 'dfa7e2cd-efcb-49c1-8ecc-38179614523f'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Flow 'volume_create_manager' (d739d1c9-7ab6-4dac-b646-0e34046b5e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8478997-11a6-4e83-bd14-27e86490ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c86343-cc39-40f3-85ad-1e5a8fd2ca47]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8478997-11a6-4e83-bd14-27e86490ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a075e554-780c-4eb9-8bb4-44f428b65f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d5a32481945819917ead494a8e20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:11Z,use_quota=True,user_id='d5b6f9126af74e67b24eb9242fe02c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e6868e-73e4-4348-9d4f-63bf84c8a658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e6868e-73e4-4348-9d4f-63bf84c8a658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d20188-b5b0-47dc-9634-bcd3ea074e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:11 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 Nov 02 14:32:11 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:11 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:11 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d20188-b5b0-47dc-9634-bcd3ea074e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a075e554-780c-4eb9-8bb4-44f428b65f7e', 'volume_name': 'volume-a075e554-780c-4eb9-8bb4-44f428b65f7e', 'volume_size': 1, 'image_id': '1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f67a069e07dcd0cbfa512594e81d8395', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '147d5a32481945819917ead494a8e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b099518bd76aeedfc9df3b717312205bbcd1c4e72419fa15f144ca2873d2ef60edde76a955cfd5f5b261b806b3ea9065610c2972df4c59dc74e3c73003fca20', 'id': '1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'created_at': datetime.datetime(2026, 11, 2, 13, 32, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 32, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8/file', 'properties': {}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f9cc26-9fc8-4436-ac73-a22861ddf48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f9cc26-9fc8-4436-ac73-a22861ddf48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958522a1-4e0c-4b12-b719-049053da526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:11 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Volume a075e554-780c-4eb9-8bb4-44f428b65f7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a075e554-780c-4eb9-8bb4-44f428b65f7e', 'volume_size': 1, 'image_id': '1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f67a069e07dcd0cbfa512594e81d8395', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '147d5a32481945819917ead494a8e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b099518bd76aeedfc9df3b717312205bbcd1c4e72419fa15f144ca2873d2ef60edde76a955cfd5f5b261b806b3ea9065610c2972df4c59dc74e3c73003fca20', 'id': '1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'created_at': datetime.datetime(2026, 11, 2, 13, 32, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 32, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8/file', 'properties': {}}, 'image_service': } Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Trying to clone a075e554-780c-4eb9-8bb4-44f428b65f7e from image 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:32:11 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:32:11 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Image download 0.00 MB at 0.00 MB/s Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258" returned: 0 in 0.598s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:11 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.452s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:11 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:11 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Deleted volume successfully. Nov 02 14:32:12 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258 Nov 02 14:32:12 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5b97b884-467a-4362-b702-26f2ab9a5b60 tempest-VolumesGetTest-879070351 None] Lock "cinder-bf78224d-4146-4c2e-a92c-289e75551b7d-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a58a79f-a8b1-4573-be9e-3d66315dfe2a]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:12 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD Nov 02 14:32:12 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:12 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1986d421-4e67-4e66-85f3-2439b0d19258" returned: 0 in 0.502s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Lock "cinder-quobyte-1986d421-4e67-4e66-85f3-2439b0d19258" released by "delete_volume" :: held 1.204s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Created reservations ['fc4dc7f6-aaa7-4354-9448-35e9c0f63887', '7d57be0a-590f-47f8-94b0-e5c17fd1f0d9', '92a43f2d-f662-442b-95a0-af95f9bf9764', '357ee692-62a3-4a74-84f6-d808212d6236'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:12 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:12 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD Nov 02 14:32:12 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:12 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:12 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:13 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.400s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Deleted volume successfully. Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-efeaf9eb-0efc-48e7-a632-49a485d1cde6 tempest-VolumesActionsTest-704982259 None] Lock "cinder-1986d421-4e67-4e66-85f3-2439b0d19258-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:13 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD" returned: 1 in 0.628s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Temporary image 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 is fetched for user d5b6f9126af74e67b24eb9242fe02c06. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f98666-fed8-485a-b81c-9922fd80d3c0]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:13 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD Nov 02 14:32:13 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:13 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:14 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a" returned: 0 in 3.024s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_m7sx08wbdevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:32:14 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Converted 112.00 MB image at 37.00 MB/s Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:14 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD Nov 02 14:32:14 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:14 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 1G Nov 02 14:32:14 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:14 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD" returned: 1 in 0.589s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a075e554-780c-4eb9-8bb4-44f428b65f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='147d5a32481945819917ead494a8e20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:11Z,use_quota=True,user_id='d5b6f9126af74e67b24eb9242fe02c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Creating volume a075e554-780c-4eb9-8bb4-44f428b65f7e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:14 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:14 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e 1073741824 Nov 02 14:32:14 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:14 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 1G" returned: 0 in 0.563s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Downloaded image 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume 3de32dad-9000-46a4-8319-d84a700ad38a successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 for user 755aa4969d9246209f0eae4758cc0717 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Marking volume 3de32dad-9000-46a4-8319-d84a700ad38a as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Copying metadata from image 038a1496-6584-48e7-a7a3-32931ae28302 to 3de32dad-9000-46a4-8319-d84a700ad38a. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Creating volume glance metadata for volume 3de32dad-9000-46a4-8319-d84a700ad38a backed by image 038a1496-6584-48e7-a7a3-32931ae28302 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbcb8cd-8bce-4438-83c7-1dde0eda9e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de32dad-9000-46a4-8319-d84a700ad38a', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b701c336-ce9c-4e0d-9f9f-34cffe554b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:14 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Volume volume-3de32dad-9000-46a4-8319-d84a700ad38a (3de32dad-9000-46a4-8319-d84a700ad38a): created successfully Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b701c336-ce9c-4e0d-9f9f-34cffe554b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Flow 'volume_create_manager' (24672071-2dcd-4797-95c0-6cfc062d7901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:14 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b4700bde-0e85-4f49-9b26-702f67d027e3 tempest-VolumesExtendTest-152523033 None] Created volume successfully. Nov 02 14:32:15 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e 1073741824" returned: 0 in 0.581s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:15 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e Nov 02 14:32:15 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:15 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e" returned: 0 in 0.332s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Attempting download of 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'metadata': {}}])) to volume a075e554-780c-4eb9-8bb4-44f428b65f7e. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b66d8-5ee7-4ae7-8d90-139ce8689ebe]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_ea8zzi28 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:15 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_ea8zzi28 Nov 02 14:32:15 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac1b6e9-0dc0-4e6a-8ed7-889d5f5d0d3d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:16 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a Nov 02 14:32:16 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:16 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_ea8zzi28" returned: 0 in 0.505s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_ea8zzi28 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:16 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_ea8zzi28 Nov 02 14:32:16 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:16 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a" returned: 0 in 0.410s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 2G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a 2G" returned: 0 in 0.113s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.573s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:16 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_ea8zzi28" returned: 1 in 0.371s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_ea8zzi28' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[497af587-55ed-4c4c-ab8c-c17c81c5d744]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-672f883d-8877-4a19-8638-ab20886cc6fc tempest-VolumesExtendTest-152523033 None] Extend volume completed successfully. Nov 02 14:32:16 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD Nov 02 14:32:16 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:16 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:17 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD Nov 02 14:32:17 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:17 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD" returned: 1 in 0.508s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 was raw, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:17 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e Nov 02 14:32:17 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (93400989-7391-4e8a-9d82-93dbb660da2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a3ce6-ac58-4c7d-b8b9-9de1052dcdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626a3ce6-ac58-4c7d-b8b9-9de1052dcdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-883361317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fefd870-96b9-4937-a751-363dc466a40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:17Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e163db-f889-4d98-b07c-16c9a3e7212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e163db-f889-4d98-b07c-16c9a3e7212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5204f740-dd38-40aa-b010-c037e207cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5204f740-dd38-40aa-b010-c037e207cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fefd870-96b9-4937-a751-363dc466a40c', 'volume_name': 'volume-8fefd870-96b9-4937-a751-363dc466a40c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335fdc52-5e11-42e0-9a22-6f1a42cbb42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335fdc52-5e11-42e0-9a22-6f1a42cbb42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8bf728-7c2b-4d90-8ffa-b8eda9769f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:17 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Volume 8fefd870-96b9-4937-a751-363dc466a40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fefd870-96b9-4937-a751-363dc466a40c', 'volume_size': 1} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-883361317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fefd870-96b9-4937-a751-363dc466a40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:17Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Creating volume 8fefd870-96b9-4937-a751-363dc466a40c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:17 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:17 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c 1073741824 Nov 02 14:32:17 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Acquiring lock "cinder-3de32dad-9000-46a4-8319-d84a700ad38a-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Lock "cinder-3de32dad-9000-46a4-8319-d84a700ad38a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Acquiring lock "cinder-quobyte-3de32dad-9000-46a4-8319-d84a700ad38a" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-3de32dad-9000-46a4-8319-d84a700ad38a" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a704c2d8-65b2-40f5-9fc5-9ddbd546cf5b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:18 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e" returned: 0 in 0.663s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e2eaa68-8615-4a75-b95d-fb23ec49eba8_d_s17dffdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:32:18 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:18 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a Nov 02 14:32:18 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:18 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e 1G Nov 02 14:32:18 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:18 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c 1073741824" returned: 0 in 0.609s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:18 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c Nov 02 14:32:18 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:18 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a" returned: 0 in 0.488s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:18 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a Nov 02 14:32:18 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:18 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e 1G" returned: 0 in 0.400s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Downloaded image 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'metadata': {}}])) to volume a075e554-780c-4eb9-8bb4-44f428b65f7e successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Temporary image 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 for user d5b6f9126af74e67b24eb9242fe02c06 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Marking volume a075e554-780c-4eb9-8bb4-44f428b65f7e as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Copying metadata from image 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 to a075e554-780c-4eb9-8bb4-44f428b65f7e. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Creating volume glance metadata for volume a075e554-780c-4eb9-8bb4-44f428b65f7e backed by image 1e2eaa68-8615-4a75-b95d-fb23ec49eba8 with: {'image_id': '1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f67a069e07dcd0cbfa512594e81d8395', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958522a1-4e0c-4b12-b719-049053da526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a075e554-780c-4eb9-8bb4-44f428b65f7e', 'volume_size': 1, 'image_id': '1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f67a069e07dcd0cbfa512594e81d8395', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '147d5a32481945819917ead494a8e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b099518bd76aeedfc9df3b717312205bbcd1c4e72419fa15f144ca2873d2ef60edde76a955cfd5f5b261b806b3ea9065610c2972df4c59dc74e3c73003fca20', 'id': '1e2eaa68-8615-4a75-b95d-fb23ec49eba8', 'created_at': datetime.datetime(2026, 11, 2, 13, 32, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 32, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e2eaa68-8615-4a75-b95d-fb23ec49eba8/file', 'properties': {}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c1e66c-d4ab-4f11-9559-b5a902dfcc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Volume volume-a075e554-780c-4eb9-8bb4-44f428b65f7e (a075e554-780c-4eb9-8bb4-44f428b65f7e): created successfully Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c1e66c-d4ab-4f11-9559-b5a902dfcc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Flow 'volume_create_manager' (d739d1c9-7ab6-4dac-b646-0e34046b5e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5cdb5425-de80-4103-9d7e-c51a4715ca67 tempest-VolumeImageDependencyTests-352680744 None] Created volume successfully. Nov 02 14:32:18 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c" returned: 0 in 0.372s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8bf728-7c2b-4d90-8ffa-b8eda9769f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fefd870-96b9-4937-a751-363dc466a40c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e9bbb0-2c2e-4454-b0b5-f79beda6f938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Volume volume-8fefd870-96b9-4937-a751-363dc466a40c (8fefd870-96b9-4937-a751-363dc466a40c): created successfully Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e9bbb0-2c2e-4454-b0b5-f79beda6f938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (93400989-7391-4e8a-9d82-93dbb660da2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ee9203cd-22e8-4706-9081-98fb231562b6 tempest-VolumesActionsTest-704982259 None] Created volume successfully. Nov 02 14:32:18 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3de32dad-9000-46a4-8319-d84a700ad38a" returned: 0 in 0.311s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-3de32dad-9000-46a4-8319-d84a700ad38a" released by "delete_volume" :: held 0.841s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Created reservations ['35a2adbd-bada-4c82-85df-b8c02312d619', '86958d98-6b67-4288-a0d0-dd0e53576782', 'c26a1d78-d17a-4782-a958-658724dca796', 'b8ddef44-355d-429d-8500-04670382d208'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:18 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:18 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Acquiring lock "cinder-a075e554-780c-4eb9-8bb4-44f428b65f7e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Lock "cinder-a075e554-780c-4eb9-8bb4-44f428b65f7e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Acquiring lock "cinder-quobyte-a075e554-780c-4eb9-8bb4-44f428b65f7e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Lock "cinder-quobyte-a075e554-780c-4eb9-8bb4-44f428b65f7e" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:19 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.299s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[67717c5c-9e5c-4994-89a9-70bc9dfb9430]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Deleted volume successfully. Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-91d717f3-d250-4219-81aa-afad5e24c739 tempest-VolumesExtendTest-152523033 None] Lock "cinder-3de32dad-9000-46a4-8319-d84a700ad38a-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:19 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e Nov 02 14:32:19 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Flow 'volume_create_manager' (7137f1d6-645a-4ef1-8111-09febc1201bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b65ec90-3bbf-4481-aaa2-befc2978191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:19 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e" returned: 0 in 0.480s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b65ec90-3bbf-4481-aaa2-befc2978191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2043230880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca8d0c9211c448ba3b28533b683b1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:20Z,use_quota=True,user_id='755aa4969d9246209f0eae4758cc0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b3204d-3c00-4d62-84af-8f492518a720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b3204d-3c00-4d62-84af-8f492518a720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:19 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e Nov 02 14:32:19 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4602461a-2011-47c5-8b36-4631971414a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4602461a-2011-47c5-8b36-4631971414a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca', 'volume_name': 'volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326742a6-e79e-4001-ad16-4011133be67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326742a6-e79e-4001-ad16-4011133be67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63076e22-4cc0-4b02-be61-feff4af82dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Volume f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca', 'volume_size': 1} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2043230880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca8d0c9211c448ba3b28533b683b1f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:20Z,use_quota=True,user_id='755aa4969d9246209f0eae4758cc0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Creating volume f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:19 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-8fefd870-96b9-4937-a751-363dc466a40c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-8fefd870-96b9-4937-a751-363dc466a40c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:19 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca 1073741824 Nov 02 14:32:19 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-quobyte-8fefd870-96b9-4937-a751-363dc466a40c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-8fefd870-96b9-4937-a751-363dc466a40c" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca78c3-eb97-4367-a7bb-59e059fc484b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:20 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a075e554-780c-4eb9-8bb4-44f428b65f7e" returned: 0 in 0.324s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Lock "cinder-quobyte-a075e554-780c-4eb9-8bb4-44f428b65f7e" released by "delete_volume" :: held 0.893s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:20 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c Nov 02 14:32:20 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Created reservations ['1c8ccdd7-52a6-48d5-bdc5-50de72ccf205', '27652553-4097-4f41-89fd-247ecf879f49', '3eae861f-e0b5-40b9-9906-98cc52e65832', 'f670855b-4e84-4a7a-80b9-151d37a74400'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:20 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:20 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:20 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca 1073741824" returned: 0 in 0.632s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:20 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c" returned: 0 in 0.492s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:20 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c Nov 02 14:32:20 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:20 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca Nov 02 14:32:20 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:20 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.332s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:20 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Deleted volume successfully. Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cc58dd94-db19-4154-b327-2da1a13441c7 tempest-VolumeImageDependencyTests-352680744 None] Lock "cinder-a075e554-780c-4eb9-8bb4-44f428b65f7e-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:20 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8fefd870-96b9-4937-a751-363dc466a40c" returned: 0 in 0.303s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-8fefd870-96b9-4937-a751-363dc466a40c" released by "delete_volume" :: held 0.860s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:20 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" returned: 0 in 0.306s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63076e22-4cc0-4b02-be61-feff4af82dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a726b3e7-8298-465d-ae3f-214dc0e8e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Created reservations ['50c6c6b2-b459-4083-bb83-ffbad64eaaa4', '21d20795-3486-4449-94d1-76888b263a5d', '15ade574-23d0-4d5c-9dd2-62cdac44c797', '6c284805-4591-48d8-8ff7-9925af6ac001'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:20 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Volume volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca (f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca): created successfully Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a726b3e7-8298-465d-ae3f-214dc0e8e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Flow 'volume_create_manager' (7137f1d6-645a-4ef1-8111-09febc1201bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:20 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e9275783-f570-4474-b76c-b0c9bb626238 tempest-VolumesExtendTest-152523033 None] Created volume successfully. Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:20 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:20 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:21 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.273s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Deleted volume successfully. Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d569cf6b-54b3-4fc2-bb7c-64c517285206 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-8fefd870-96b9-4937-a751-363dc466a40c-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (6a779609-a641-4e3d-8a53-c9b4d32c5f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c6ec43-25ae-4302-8252-25cbd5907162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c6ec43-25ae-4302-8252-25cbd5907162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-754917232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bfa920-2589-42cd-b3ec-a637b34ccf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:22Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df619e8-b600-43bb-8ac7-e00af115e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df619e8-b600-43bb-8ac7-e00af115e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e0750d-e091-4127-a4d4-d48616c301d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e0750d-e091-4127-a4d4-d48616c301d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65bfa920-2589-42cd-b3ec-a637b34ccf36', 'volume_name': 'volume-65bfa920-2589-42cd-b3ec-a637b34ccf36', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945418a9-2e04-4512-872a-bb16ffa02883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945418a9-2e04-4512-872a-bb16ffa02883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa41f17-0af0-44b1-b254-2d7bb9f525c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:21 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Volume 65bfa920-2589-42cd-b3ec-a637b34ccf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65bfa920-2589-42cd-b3ec-a637b34ccf36', 'volume_size': 1} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-754917232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65bfa920-2589-42cd-b3ec-a637b34ccf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:22Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Creating volume 65bfa920-2589-42cd-b3ec-a637b34ccf36 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:21 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:21 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 1073741824 Nov 02 14:32:21 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:22 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 1073741824" returned: 0 in 0.605s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:22 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 Nov 02 14:32:22 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Flow 'volume_create_manager' (6766425c-fb7b-47ca-929c-464fc79fafe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6e1eea-8888-44cb-a879-e5771fc0badf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6e1eea-8888-44cb-a879-e5771fc0badf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905086258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f3d572-e897-4834-9298-726add7be2fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8026ed033524682bcbd274c08c403a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:22Z,use_quota=True,user_id='085ae1f08bad428ca7ae7a96b9aa89ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f555854-f115-475c-b7e8-8044c08f78d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f555854-f115-475c-b7e8-8044c08f78d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40816e18-ee34-43f1-9a67-9d661e46d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40816e18-ee34-43f1-9a67-9d661e46d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f3d572-e897-4834-9298-726add7be2fb', 'volume_name': 'volume-c9f3d572-e897-4834-9298-726add7be2fb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8b5c84-48bf-4a7f-ade3-2e303791c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8b5c84-48bf-4a7f-ade3-2e303791c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd035bf-3038-40e9-b967-35924736b8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Volume c9f3d572-e897-4834-9298-726add7be2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f3d572-e897-4834-9298-726add7be2fb', 'volume_size': 1} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:22 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36" returned: 0 in 0.298s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Creating offline snapshot b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb of volume f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa41f17-0af0-44b1-b254-2d7bb9f525c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65bfa920-2589-42cd-b3ec-a637b34ccf36', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef13372-5722-455c-9dc3-54a205d39ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ce69a2-bf1d-4451-b9f3-15bf25f64c15]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Volume volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 (65bfa920-2589-42cd-b3ec-a637b34ccf36): created successfully Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef13372-5722-455c-9dc3-54a205d39ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (6a779609-a641-4e3d-8a53-c9b4d32c5f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ac789a01-6494-4e41-bf84-32811b8b7547 tempest-VolumesActionsTest-704982259 None] Created volume successfully. Nov 02 14:32:22 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca Nov 02 14:32:22 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:23 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" returned: 0 in 0.399s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:23 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb 1G Nov 02 14:32:23 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:23 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb 1G" returned: 0 in 0.409s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:23 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb Nov 02 14:32:23 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-65bfa920-2589-42cd-b3ec-a637b34ccf36-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:23 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" returned: 0 in 0.334s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:23 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb is being set with open permissions: ugo+rw Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Lock "cinder-65bfa920-2589-42cd-b3ec-a637b34ccf36-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:23 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb Nov 02 14:32:23 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-quobyte-65bfa920-2589-42cd-b3ec-a637b34ccf36" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-65bfa920-2589-42cd-b3ec-a637b34ccf36" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[be230cec-ef8e-4ce4-8b8e-1ab9f0d48b4f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:24 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 Nov 02 14:32:24 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:24 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" returned: 0 in 0.314s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:24 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.info Nov 02 14:32:24 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:24 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:24 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36 Nov 02 14:32:24 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:24 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.info" returned: 0 in 0.306s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:24 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.info is being set with open permissions: ugo+rw Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:24 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.info Nov 02 14:32:24 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:24 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65bfa920-2589-42cd-b3ec-a637b34ccf36" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-65bfa920-2589-42cd-b3ec-a637b34ccf36" released by "delete_volume" :: held 0.720s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Created reservations ['77cac811-3ae0-4d70-90ac-91d92d57b33d', '6c5812d9-1083-4377-a3fd-007f48fda1d6', '52afb729-c1e6-4546-9604-e6b4f04a9872', '16850c43-263f-4939-969f-936fa5f42ce6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:24 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.info" returned: 0 in 0.260s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.305s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1905086258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f3d572-e897-4834-9298-726add7be2fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8026ed033524682bcbd274c08c403a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:22Z,use_quota=True,user_id='085ae1f08bad428ca7ae7a96b9aa89ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Creating volume c9f3d572-e897-4834-9298-726add7be2fb {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:24 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:24 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb 1073741824 Nov 02 14:32:24 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:24 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0ae71ffd-6dc9-4b30-9589-15abbc9e27e4 tempest-VolumesExtendTest-152523033 None] Create snapshot completed successfully Nov 02 14:32:24 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:24 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:25 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.324s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Deleted volume successfully. Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e293e6ea-0693-4f1a-adf4-a3d69e79888b tempest-VolumesActionsTest-1603964918 None] Lock "cinder-65bfa920-2589-42cd-b3ec-a637b34ccf36-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:25 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb 1073741824" returned: 0 in 0.601s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:25 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb Nov 02 14:32:25 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (55bc80cd-26b9-4377-8f9e-d48a32668e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2da2c68-e170-497a-bc8a-dc10cee8a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:25 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.411s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2da2c68-e170-497a-bc8a-dc10cee8a943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1457452425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee75cd-fa75-4dfe-a9db-7eaf91ef05bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:26Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbe8e17-7738-4b17-8d25-f386f9f9397f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbe8e17-7738-4b17-8d25-f386f9f9397f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703b9ad1-c614-4422-8f5c-8c147e02f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703b9ad1-c614-4422-8f5c-8c147e02f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beee75cd-fa75-4dfe-a9db-7eaf91ef05bf', 'volume_name': 'volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c75de0-b822-4749-bf10-33e09592edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c75de0-b822-4749-bf10-33e09592edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2814ff8f-5640-4b61-b57c-d5c4a3e9d2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:25 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Volume beee75cd-fa75-4dfe-a9db-7eaf91ef05bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf', 'volume_size': 1} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9712f2-f46d-4b6c-bfc7-5e3a1bd5cd30]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd035bf-3038-40e9-b967-35924736b8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f3d572-e897-4834-9298-726add7be2fb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fefb02-9f67-4988-a7cf-a840971f52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:25 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Volume volume-c9f3d572-e897-4834-9298-726add7be2fb (c9f3d572-e897-4834-9298-726add7be2fb): created successfully Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fefb02-9f67-4988-a7cf-a840971f52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Flow 'volume_create_manager' (6766425c-fb7b-47ca-929c-464fc79fafe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-80881820-4341-4667-8200-7eff18d45861 tempest-VolumesListTestJSON-1468359515 None] Created volume successfully. Nov 02 14:32:25 devstack sudo[98243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca Nov 02 14:32:25 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:26 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" returned: 0 in 0.444s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb 2G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb 2G" returned: 0 in 0.145s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.675s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1457452425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beee75cd-fa75-4dfe-a9db-7eaf91ef05bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:26Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Creating volume beee75cd-fa75-4dfe-a9db-7eaf91ef05bf {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:26 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:26 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf 1073741824 Nov 02 14:32:26 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a4f8b275-9ac7-4a59-ad5c-82847cf3ad9e tempest-VolumesExtendTest-152523033 None] Extend volume completed successfully. Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Acquiring lock "cinder-b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Lock "cinder-b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Acquiring lock "cinder-quobyte-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Acquiring lock "cinder-quobyte-b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Deleting offline snapshot b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb of volume f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] snapshot_file for this snap is: volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5486655-5400-499b-b9bb-3b3bd7b88cac]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:26 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf 1073741824" returned: 0 in 0.549s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:27 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf Nov 02 14:32:27 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:27 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb Nov 02 14:32:27 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:27 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf" returned: 0 in 0.392s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2814ff8f-5640-4b61-b57c-d5c4a3e9d2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fbb604-bef3-4ab3-8d81-e2e72e2483e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:27 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" returned: 0 in 0.555s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:32:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Volume volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf (beee75cd-fa75-4dfe-a9db-7eaf91ef05bf): created successfully Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fbb604-bef3-4ab3-8d81-e2e72e2483e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (55bc80cd-26b9-4377-8f9e-d48a32668e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[02106f38-ac9a-45ae-9dc0-647a4b1c7ba3]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:27 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-82c85d3a-7cfa-41ce-aecf-2d1d176b31de tempest-VolumesActionsTest-704982259 None] Created volume successfully. Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Flow 'volume_create_manager' (baa0362a-b422-42db-8bf0-6877ab92e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcce79c-d1da-4093-b709-6ff6645f3e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcce79c-d1da-4093-b709-6ff6645f3e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1367809824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87da6451-aa12-4ba6-a115-5778917ff077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8026ed033524682bcbd274c08c403a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:27Z,use_quota=True,user_id='085ae1f08bad428ca7ae7a96b9aa89ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f7d119-c35a-4949-8cb0-e0aa392ff9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f7d119-c35a-4949-8cb0-e0aa392ff9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678294c9-9c99-4f2a-8db6-ca8ace90215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678294c9-9c99-4f2a-8db6-ca8ace90215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87da6451-aa12-4ba6-a115-5778917ff077', 'volume_name': 'volume-87da6451-aa12-4ba6-a115-5778917ff077', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a51bf1a-62d2-4340-aee6-d2cbaa9c8390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a51bf1a-62d2-4340-aee6-d2cbaa9c8390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3288ca2c-f52f-408f-a5fd-720e064d1b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Volume 87da6451-aa12-4ba6-a115-5778917ff077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87da6451-aa12-4ba6-a115-5778917ff077', 'volume_size': 1} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1367809824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87da6451-aa12-4ba6-a115-5778917ff077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8026ed033524682bcbd274c08c403a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:27Z,use_quota=True,user_id='085ae1f08bad428ca7ae7a96b9aa89ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Creating volume 87da6451-aa12-4ba6-a115-5778917ff077 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:27 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca Nov 02 14:32:27 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:27 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:27 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 1073741824 Nov 02 14:32:27 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:28 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" returned: 0 in 0.505s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Lock "cinder-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:28 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb Nov 02 14:32:28 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-quobyte-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c80802a-584b-4fd1-bde2-8b4a6fbf2b7d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:28 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 1073741824" returned: 0 in 0.566s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:28 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 Nov 02 14:32:28 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:28 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf Nov 02 14:32:28 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:28 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" returned: 0 in 0.526s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:28 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb Nov 02 14:32:28 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:28 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077" returned: 0 in 0.335s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3288ca2c-f52f-408f-a5fd-720e064d1b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87da6451-aa12-4ba6-a115-5778917ff077', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baff468d-5596-484b-898a-a2a9331ede20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:28 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf" returned: 0 in 0.462s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:28 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Volume volume-87da6451-aa12-4ba6-a115-5778917ff077 (87da6451-aa12-4ba6-a115-5778917ff077): created successfully Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baff468d-5596-484b-898a-a2a9331ede20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Flow 'volume_create_manager' (baa0362a-b422-42db-8bf0-6877ab92e921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e4771d55-ebdb-476c-acad-8458fdb87a46 tempest-VolumesListTestJSON-1468359515 None] Created volume successfully. Nov 02 14:32:28 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf Nov 02 14:32:28 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:28 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca.b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb" released by "_delete_snapshot" :: held 2.117s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" released by "delete_snapshot" :: held 2.147s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:29 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf" returned: 0 in 0.359s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf" released by "delete_volume" :: held 0.870s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Created reservations ['46559d4e-5f4f-4076-bbe6-34ba74900bc7', '1a15528f-cb64-4ffc-a511-85d58e8040ea', 'e896288e-f7aa-4934-bf97-e2cb1f46a27d', '35220f07-ff3c-4bc6-af2b-5549d79329d3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Created reservations ['a785c599-44c9-42c5-8265-d8ecfe7e129a', 'cbe4ad42-6083-42f1-b4cf-9253a00b450c', '84c31017-3b20-4082-8601-8977efb19123', '8ed623b2-92c0-44f8-8a2d-5727cd2016a5'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Delete snapshot completed successfully. Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8de6cdb9-0360-4e0a-8162-ff7c327a26df tempest-VolumesExtendTest-152523033 None] Lock "cinder-b2a2f3fe-7a74-4d26-8fdb-6832a9c7bcbb-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:29 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:29 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:29 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.242s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Deleted volume successfully. Nov 02 14:32:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1befba62-a99f-48d8-ab93-e5e04ff14a7c tempest-VolumesActionsTest-1603964918 None] Lock "cinder-beee75cd-fa75-4dfe-a9db-7eaf91ef05bf-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Acquiring lock "cinder-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Lock "cinder-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Flow 'volume_create_manager' (667bfa7e-3980-42f9-b544-a4b22a7a1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81593c89-8b8c-461c-b655-330cd1afb644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81593c89-8b8c-461c-b655-330cd1afb644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1024033784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c65ef-0bae-4e1d-9652-8ee473a28297,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8026ed033524682bcbd274c08c403a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:30Z,use_quota=True,user_id='085ae1f08bad428ca7ae7a96b9aa89ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24c6ca8-9451-4396-ab55-7d304f1ee8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24c6ca8-9451-4396-ab55-7d304f1ee8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6d3f08-e536-4c30-9c7b-162240338ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6d3f08-e536-4c30-9c7b-162240338ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395c65ef-0bae-4e1d-9652-8ee473a28297', 'volume_name': 'volume-395c65ef-0bae-4e1d-9652-8ee473a28297', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b796c7d-7b3b-4dff-9cd6-f25e7c0cad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b796c7d-7b3b-4dff-9cd6-f25e7c0cad93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8174afe-cdb7-4879-91d1-dd8d4a350715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Volume 395c65ef-0bae-4e1d-9652-8ee473a28297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395c65ef-0bae-4e1d-9652-8ee473a28297', 'volume_size': 1} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1024033784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c65ef-0bae-4e1d-9652-8ee473a28297,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c8026ed033524682bcbd274c08c403a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:30Z,use_quota=True,user_id='085ae1f08bad428ca7ae7a96b9aa89ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Creating volume 395c65ef-0bae-4e1d-9652-8ee473a28297 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:30 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Acquiring lock "cinder-quobyte-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:30 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 1073741824 Nov 02 14:32:30 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91895d1-b742-4ac8-842f-ec02cbc0e488]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:30 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca Nov 02 14:32:30 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:30 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" returned: 0 in 0.407s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:30 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 1073741824" returned: 0 in 0.516s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:30 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca Nov 02 14:32:30 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:30 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 Nov 02 14:32:30 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (e2393891-6f27-4924-9440-c0356009e0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1e62c1-b0a1-40cc-8bcd-c1cc288a4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1e62c1-b0a1-40cc-8bcd-c1cc288a4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-116395336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82042c9-c231-466f-a8c6-ecfcf8827824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:31Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb466178-7f94-4d9c-b8bb-c59f2f9253f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb466178-7f94-4d9c-b8bb-c59f2f9253f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa64b4c-06be-44e0-a426-f87329a9e06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa64b4c-06be-44e0-a426-f87329a9e06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82042c9-c231-466f-a8c6-ecfcf8827824', 'volume_name': 'volume-a82042c9-c231-466f-a8c6-ecfcf8827824', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a7cd7d-942f-4715-ab86-752fc4ff4606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a7cd7d-942f-4715-ab86-752fc4ff4606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab876fca-426d-45ce-88c6-4095a3eac76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:30 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Volume a82042c9-c231-466f-a8c6-ecfcf8827824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82042c9-c231-466f-a8c6-ecfcf8827824', 'volume_size': 1} Nov 02 14:32:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:31 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Lock "cinder-quobyte-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca" released by "delete_volume" :: held 0.770s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:31 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297" returned: 0 in 0.273s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.179s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-116395336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82042c9-c231-466f-a8c6-ecfcf8827824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:31Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Creating volume a82042c9-c231-466f-a8c6-ecfcf8827824 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:31 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8174afe-cdb7-4879-91d1-dd8d4a350715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395c65ef-0bae-4e1d-9652-8ee473a28297', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b792e-ec03-49c3-8c58-53ab6de4f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:31 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 1073741824 Nov 02 14:32:31 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:31 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Volume volume-395c65ef-0bae-4e1d-9652-8ee473a28297 (395c65ef-0bae-4e1d-9652-8ee473a28297): created successfully Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31b792e-ec03-49c3-8c58-53ab6de4f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Flow 'volume_create_manager' (667bfa7e-3980-42f9-b544-a4b22a7a1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Created reservations ['366425ac-a949-4a49-bbbe-66006c032e2e', '8742d3a7-1f67-4a02-bfe1-5eed6ae51c84', '453f7b64-7e2a-4431-bbbf-3d2f7e77ffa3', 'c6f45a0e-a3cb-4667-b123-1ba0b527a647'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3fc8298d-6c89-49e3-94d1-ad4c196dab1c tempest-VolumesListTestJSON-1468359515 None] Created volume successfully. Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:31 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:31 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:31 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.250s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Deleted volume successfully. Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d30a862d-aec3-4cfc-a86d-0c292695427d tempest-VolumesExtendTest-152523033 None] Lock "cinder-f09f99a2-9fd3-45a1-8e42-4b5b917ff8ca-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:31 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 1073741824" returned: 0 in 0.452s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:31 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 Nov 02 14:32:31 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:31 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824" returned: 0 in 0.240s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab876fca-426d-45ce-88c6-4095a3eac76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82042c9-c231-466f-a8c6-ecfcf8827824', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab076077-4b4c-4ad7-948d-0ff0050942db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:31 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Volume volume-a82042c9-c231-466f-a8c6-ecfcf8827824 (a82042c9-c231-466f-a8c6-ecfcf8827824): created successfully Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab076077-4b4c-4ad7-948d-0ff0050942db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (e2393891-6f27-4924-9440-c0356009e0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-da263396-fc2d-4cdc-a93f-27f841f04b0c tempest-VolumesActionsTest-704982259 None] Created volume successfully. Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-a82042c9-c231-466f-a8c6-ecfcf8827824-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-a82042c9-c231-466f-a8c6-ecfcf8827824-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Acquiring lock "cinder-quobyte-a82042c9-c231-466f-a8c6-ecfcf8827824" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-a82042c9-c231-466f-a8c6-ecfcf8827824" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde7c82-0f8c-4d6f-8454-17170be469b3]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:33 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 Nov 02 14:32:33 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:33 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824" returned: 0 in 0.450s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:33 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824 Nov 02 14:32:33 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:33 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a82042c9-c231-466f-a8c6-ecfcf8827824" returned: 0 in 0.328s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-quobyte-a82042c9-c231-466f-a8c6-ecfcf8827824" released by "delete_volume" :: held 0.842s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Created reservations ['4d46b219-f398-431b-9b66-ce1966f92ae7', 'a412783f-9e8c-4612-a2bc-7f1d8f1f6e40', '59135dda-7885-4a88-8c1d-4b5498c2151d', 'b7aaa7eb-d387-44bb-9891-ccb3a151bdf9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:34 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:34 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:34 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.311s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Deleted volume successfully. Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-16c1469e-30f2-492a-90f0-f76e8f29ca19 tempest-VolumesActionsTest-1603964918 None] Lock "cinder-a82042c9-c231-466f-a8c6-ecfcf8827824-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (2cef9b21-c493-49ec-b93b-b47e5b55cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c5bf34-944a-4531-983c-7d53bb9016fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "cinder-395c65ef-0bae-4e1d-9652-8ee473a28297-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c5bf34-944a-4531-983c-7d53bb9016fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1446723512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb84f9-9cd2-4823-b2f2-314d37e263c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:35Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fd6bf1-0747-499c-8db3-25e8419a6b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fd6bf1-0747-499c-8db3-25e8419a6b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e062266-cf77-4c3b-a97a-f4cf453e2caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e062266-cf77-4c3b-a97a-f4cf453e2caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eb84f9-9cd2-4823-b2f2-314d37e263c2', 'volume_name': 'volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c337349b-d7a8-49a4-9d4d-f3707bc6873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c337349b-d7a8-49a4-9d4d-f3707bc6873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3799e98b-5c14-42c9-a1b4-4682983d1220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:34 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Volume 98eb84f9-9cd2-4823-b2f2-314d37e263c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2', 'volume_size': 1} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1446723512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb84f9-9cd2-4823-b2f2-314d37e263c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='698b151a470c48b89b3773359606a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:35Z,use_quota=True,user_id='0816743204a1445dac25867931aad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Creating volume 98eb84f9-9cd2-4823-b2f2-314d37e263c2 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:34 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-395c65ef-0bae-4e1d-9652-8ee473a28297-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:34 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 1073741824 Nov 02 14:32:34 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "cinder-quobyte-395c65ef-0bae-4e1d-9652-8ee473a28297" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-quobyte-395c65ef-0bae-4e1d-9652-8ee473a28297" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2125a0b5-8f17-422f-bd9e-12d85fc73a6d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:35 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 Nov 02 14:32:35 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:35 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 1073741824" returned: 0 in 0.502s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:35 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297" returned: 0 in 0.417s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:35 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 Nov 02 14:32:35 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:35 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297 Nov 02 14:32:35 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:35 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2" returned: 0 in 0.310s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3799e98b-5c14-42c9-a1b4-4682983d1220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:35 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61898851-18e8-493f-bf70-5c71dae46666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-395c65ef-0bae-4e1d-9652-8ee473a28297" returned: 0 in 0.326s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Volume volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 (98eb84f9-9cd2-4823-b2f2-314d37e263c2): created successfully Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61898851-18e8-493f-bf70-5c71dae46666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Flow 'volume_create_manager' (2cef9b21-c493-49ec-b93b-b47e5b55cc67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-quobyte-395c65ef-0bae-4e1d-9652-8ee473a28297" released by "delete_volume" :: held 0.808s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-db51e629-9488-46d0-bce3-8cbd04478f6c tempest-VolumesActionsTest-704982259 None] Created volume successfully. Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Created reservations ['afc925ad-00ec-4bed-bb14-985cb917c951', '30418fcb-ebf8-424b-9331-8977665682f3', '6507b4eb-e845-47ee-869c-57346d779f18', 'beb1ecc1-6dd8-4288-a01f-1912f07ba502'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:36 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:36 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:36 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:36 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:36 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Deleted volume successfully. Nov 02 14:32:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4bbc88c5-0ed0-46f6-8ff8-bf6c4b7ba5df tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-395c65ef-0bae-4e1d-9652-8ee473a28297-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "cinder-87da6451-aa12-4ba6-a115-5778917ff077-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-87da6451-aa12-4ba6-a115-5778917ff077-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "cinder-quobyte-87da6451-aa12-4ba6-a115-5778917ff077" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-quobyte-87da6451-aa12-4ba6-a115-5778917ff077" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b04275f-aa2e-40ec-be07-386f003f3e0b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:37 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 Nov 02 14:32:37 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Acquiring lock "cinder-98eb84f9-9cd2-4823-b2f2-314d37e263c2-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Lock "cinder-98eb84f9-9cd2-4823-b2f2-314d37e263c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Acquiring lock "cinder-quobyte-98eb84f9-9cd2-4823-b2f2-314d37e263c2" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Lock "cinder-quobyte-98eb84f9-9cd2-4823-b2f2-314d37e263c2" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6913bf8-c805-486a-b307-2d43d3c99344]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:37 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077" returned: 0 in 0.460s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:37 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077 Nov 02 14:32:37 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:37 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 Nov 02 14:32:37 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:38 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-87da6451-aa12-4ba6-a115-5778917ff077" returned: 0 in 0.264s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-quobyte-87da6451-aa12-4ba6-a115-5778917ff077" released by "delete_volume" :: held 0.778s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Created reservations ['75793d0a-e05c-43b0-b6de-6a50c19c432f', '5f61d0c7-d568-43d6-8276-6206e7dee0fb', '5db2e776-3a51-4e88-9407-8ace6239d31f', '15f18289-4e06-4580-a777-70014d8f0b54'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:38 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2" returned: 0 in 0.389s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:38 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2 Nov 02 14:32:38 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:38 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:38 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "cinder-c9f3d572-e897-4834-9298-726add7be2fb-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:38 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-98eb84f9-9cd2-4823-b2f2-314d37e263c2" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-c9f3d572-e897-4834-9298-726add7be2fb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Lock "cinder-quobyte-98eb84f9-9cd2-4823-b2f2-314d37e263c2" released by "delete_volume" :: held 0.846s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "cinder-quobyte-c9f3d572-e897-4834-9298-726add7be2fb" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:32:38 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-quobyte-c9f3d572-e897-4834-9298-726add7be2fb" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:32:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Deleted volume successfully. Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd2928-bb38-44a4-be1b-65e7d6973824]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f9dc3e17-6c3d-4274-a9ac-b548246a71a4 tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-87da6451-aa12-4ba6-a115-5778917ff077-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Created reservations ['4567b33d-6ebb-421d-8371-fa10064200b0', '6f1e139b-7a10-453d-a7a1-ab0646f0f1be', 'eae9d543-ea18-49fe-aa01-734680331770', '02bda1ae-a1d7-4217-a829-54987c537554'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:38 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:38 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb Nov 02 14:32:38 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:38 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:39 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:39 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:39 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Deleted volume successfully. Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb" returned: 0 in 0.468s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:39 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:39 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7fd21d93-732a-4195-a65b-5cdbce077444 tempest-VolumesActionsTest-704982259 None] Lock "cinder-98eb84f9-9cd2-4823-b2f2-314d37e263c2-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:39 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb Nov 02 14:32:39 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:39 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.295s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:32:39 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c9f3d572-e897-4834-9298-726add7be2fb" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-quobyte-c9f3d572-e897-4834-9298-726add7be2fb" released by "delete_volume" :: held 0.829s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=253,cinder:SELECT=188,cinder:INSERT=66,cinder:DELETE=17 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Created reservations ['aac051a8-c6b3-461e-aeed-f872a2086230', '883b0439-151b-48df-9128-c673e623a0c0', '9e6399f1-03bb-4678-9919-0522997d3440', '7a5c9fc0-44a3-4675-ba9e-e3d3a9ef8577'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=180,cinder:INSERT=80,cinder:UPDATE=238,cinder:DELETE=23 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:39 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:32:39 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:39 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.274s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:32:39 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Deleted volume successfully. Nov 02 14:32:39 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9deaf55f-ba30-4563-9241-baf4d0cb7e0c tempest-VolumesListTestJSON-1468359515 None] Lock "cinder-c9f3d572-e897-4834-9298-726add7be2fb-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:32:49 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:INSERT=2,cinder:UPDATE=10,cinder:SELECT=3 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:32:49 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:32:56 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Flow 'volume_create_manager' (10b92971-f36f-4a0b-b860-d7469c4fba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee84f85-a857-4070-a7a8-4956656a0ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee84f85-a857-4070-a7a8-4956656a0ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1871046572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b31f75-1b80-40e2-b85a-da7bfe375fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f6deaed3e5477cac661ccc2d9bccb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:57Z,use_quota=True,user_id='9e55261e22704840a3ee4c5911718360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbf2141-7b39-43f7-b81b-09fe5bcf933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbf2141-7b39-43f7-b81b-09fe5bcf933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a9fe88-ed96-438e-ac07-fe30d83fa288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a9fe88-ed96-438e-ac07-fe30d83fa288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b31f75-1b80-40e2-b85a-da7bfe375fbc', 'volume_name': 'volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622d5f0b-3c02-4106-8f3f-a8b94785e8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622d5f0b-3c02-4106-8f3f-a8b94785e8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d55f5a-1b24-477c-80a2-461054f5a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Volume 09b31f75-1b80-40e2-b85a-da7bfe375fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc', 'volume_size': 1} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1871046572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b31f75-1b80-40e2-b85a-da7bfe375fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f6deaed3e5477cac661ccc2d9bccb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:57Z,use_quota=True,user_id='9e55261e22704840a3ee4c5911718360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Creating volume 09b31f75-1b80-40e2-b85a-da7bfe375fbc {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:57 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:57 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc 1073741824 Nov 02 14:32:57 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Flow 'volume_create_manager' (8ef3aa6d-c0fa-40e6-a141-00dd6068fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4caf2c-70f1-4b24-b129-69fbae94dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d4caf2c-70f1-4b24-b129-69fbae94dac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-15220249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baf986-7627-40b6-b609-abe0a37370ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f6deaed3e5477cac661ccc2d9bccb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:57Z,use_quota=True,user_id='9e55261e22704840a3ee4c5911718360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b82b93-20be-4dd4-bba2-66f0cf5fcaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b82b93-20be-4dd4-bba2-66f0cf5fcaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa55686-8fa4-475c-91c1-7a359cdae142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa55686-8fa4-475c-91c1-7a359cdae142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69baf986-7627-40b6-b609-abe0a37370ff', 'volume_name': 'volume-69baf986-7627-40b6-b609-abe0a37370ff', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ae5e8a-22f2-48a6-be9b-e4fbab666b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ae5e8a-22f2-48a6-be9b-e4fbab666b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e130614-2a7d-4d90-af74-dad4a6c3f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:57 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Volume 69baf986-7627-40b6-b609-abe0a37370ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69baf986-7627-40b6-b609-abe0a37370ff', 'volume_size': 1} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:57 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc 1073741824" returned: 0 in 0.546s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:57 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc Nov 02 14:32:57 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:58 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc" returned: 0 in 0.352s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-15220249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baf986-7627-40b6-b609-abe0a37370ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f6deaed3e5477cac661ccc2d9bccb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:32:57Z,use_quota=True,user_id='9e55261e22704840a3ee4c5911718360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Creating volume 69baf986-7627-40b6-b609-abe0a37370ff {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:32:58 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d55f5a-1b24-477c-80a2-461054f5a849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:58 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff 1073741824 Nov 02 14:32:58 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f5b7d6-4a3f-4cf5-8112-da91d06666ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:58 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Volume volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc (09b31f75-1b80-40e2-b85a-da7bfe375fbc): created successfully Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f5b7d6-4a3f-4cf5-8112-da91d06666ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Flow 'volume_create_manager' (10b92971-f36f-4a0b-b860-d7469c4fba78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b8a08396-e3d6-4a47-8b32-fafb6d458011 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Created volume successfully. Nov 02 14:32:58 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff 1073741824" returned: 0 in 0.616s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:32:58 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff Nov 02 14:32:58 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:32:59 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Nov 02 14:32:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff" returned: 0 in 0.283s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:32:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:32:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:32:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e130614-2a7d-4d90-af74-dad4a6c3f821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69baf986-7627-40b6-b609-abe0a37370ff', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484aafa1-07e6-41fc-92ad-b29e4b4a8c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:32:59 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Volume volume-69baf986-7627-40b6-b609-abe0a37370ff (69baf986-7627-40b6-b609-abe0a37370ff): created successfully Nov 02 14:32:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484aafa1-07e6-41fc-92ad-b29e4b4a8c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:32:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Flow 'volume_create_manager' (8ef3aa6d-c0fa-40e6-a141-00dd6068fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:32:59 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0fa8430d-1101-4abc-9ebb-beabe39d3121 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Created volume successfully. Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Flow 'volume_create_manager' (b52c3418-80b1-4be6-be1e-f0c12104bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3ec5fc-1a2b-432f-bcdd-bacce221c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed3ec5fc-1a2b-432f-bcdd-bacce221c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1261075322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17312d22-2a37-42d1-b9c3-348eeeb5af2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e658987139d4c819ecefb43b5d874cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:06Z,use_quota=True,user_id='2d0597e94b9a40f2940dc01578a7a1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fae38cd-8441-4b83-8896-7bb1e1f16b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fae38cd-8441-4b83-8896-7bb1e1f16b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9e358b-3b8e-4c62-9aaa-ba95b7060d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9e358b-3b8e-4c62-9aaa-ba95b7060d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17312d22-2a37-42d1-b9c3-348eeeb5af2f', 'volume_name': 'volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1f867d-b3c2-41de-9d06-e89cdc41f370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b1f867d-b3c2-41de-9d06-e89cdc41f370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecd9e0c-4223-4e7f-b00c-af77a50d7fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:06 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Volume 17312d22-2a37-42d1-b9c3-348eeeb5af2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 14:33:06 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Trying to clone 17312d22-2a37-42d1-b9c3-348eeeb5af2f from image 038a1496-6584-48e7-a7a3-32931ae28302 at location (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:33:07 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:33:07 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Image download 20.69 MB at 20.69 MB/s Nov 02 14:33:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca642bb-5055-4814-809c-10e319e8e929]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:07 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD Nov 02 14:33:07 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:07 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:07 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 is fetched for user 2d0597e94b9a40f2940dc01578a7a1f4. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:33:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[85423a11-2a24-447c-a956-129ab0d746ef]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:07 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD Nov 02 14:33:07 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:08 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD" returned: 0 in 0.574s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1261075322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17312d22-2a37-42d1-b9c3-348eeeb5af2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e658987139d4c819ecefb43b5d874cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:06Z,use_quota=True,user_id='2d0597e94b9a40f2940dc01578a7a1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Creating volume 17312d22-2a37-42d1-b9c3-348eeeb5af2f {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:33:08 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:33:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:08 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f 1073741824 Nov 02 14:33:08 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:09 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f 1073741824" returned: 0 in 0.717s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:09 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f Nov 02 14:33:09 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:09 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Attempting download of 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume 17312d22-2a37-42d1-b9c3-348eeeb5af2f. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7615f4d8-f621-4025-bd53-4c73074f9004]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_3z8qfmj_ {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:09 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_3z8qfmj_ Nov 02 14:33:09 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:10 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_3z8qfmj_" returned: 0 in 0.505s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_3z8qfmj_ {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:10 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_3z8qfmj_ Nov 02 14:33:10 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:10 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_3z8qfmj_" returned: 1 in 0.468s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_3z8qfmj_' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:33:10 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4367cb3b-c699-4865-959e-ecafdba05ced]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:10 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD Nov 02 14:33:10 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:11 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:11 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] 038a1496-6584-48e7-a7a3-32931ae28302 was qcow2, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:33:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:11 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f Nov 02 14:33:11 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:13 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f" returned: 0 in 2.810s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:13 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_hghj7sm_devstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:33:13 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Converted 112.00 MB image at 39.83 MB/s Nov 02 14:33:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:13 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f 1G Nov 02 14:33:13 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:14 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f 1G" returned: 0 in 0.484s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Downloaded image 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume 17312d22-2a37-42d1-b9c3-348eeeb5af2f successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 for user 2d0597e94b9a40f2940dc01578a7a1f4 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Marking volume 17312d22-2a37-42d1-b9c3-348eeeb5af2f as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Copying metadata from image 038a1496-6584-48e7-a7a3-32931ae28302 to 17312d22-2a37-42d1-b9c3-348eeeb5af2f. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Creating volume glance metadata for volume 17312d22-2a37-42d1-b9c3-348eeeb5af2f backed by image 038a1496-6584-48e7-a7a3-32931ae28302 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecd9e0c-4223-4e7f-b00c-af77a50d7fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c18a8ec-dfaf-4e0d-b6dd-683a7f0835e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:14 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Volume volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f (17312d22-2a37-42d1-b9c3-348eeeb5af2f): created successfully Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c18a8ec-dfaf-4e0d-b6dd-683a7f0835e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Flow 'volume_create_manager' (b52c3418-80b1-4be6-be1e-f0c12104bc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:14 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7bc258aa-03c6-4c99-8790-61bfc33892b9 tempest-VolumesImageMetadata-810182808 None] Created volume successfully. Nov 02 14:33:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Acquiring lock "cinder-17312d22-2a37-42d1-b9c3-348eeeb5af2f-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Lock "cinder-17312d22-2a37-42d1-b9c3-348eeeb5af2f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Acquiring lock "cinder-quobyte-17312d22-2a37-42d1-b9c3-348eeeb5af2f" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Lock "cinder-quobyte-17312d22-2a37-42d1-b9c3-348eeeb5af2f" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed04dae-2f68-49e6-99b2-430dd95f4063]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:16 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f Nov 02 14:33:16 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:16 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f" returned: 0 in 0.543s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:16 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f Nov 02 14:33:16 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:16 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17312d22-2a37-42d1-b9c3-348eeeb5af2f" returned: 0 in 0.283s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Lock "cinder-quobyte-17312d22-2a37-42d1-b9c3-348eeeb5af2f" released by "delete_volume" :: held 0.883s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Created reservations ['f4279806-995b-4d22-8f4b-87c4ce34f2b4', '409e26b2-0cdd-4412-a1e8-32f1b309aa86', '044841b6-939c-4666-bab3-ccf24bb4a290', '366dc8bb-c5d7-4c92-beef-1e01626ea807'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:17 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:33:17 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:17 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.297s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:33:17 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Deleted volume successfully. Nov 02 14:33:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-313f534e-6b30-4777-9a70-64cfc0d9ee2a tempest-VolumesImageMetadata-810182808 None] Lock "cinder-17312d22-2a37-42d1-b9c3-348eeeb5af2f-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Flow 'volume_create_manager' (709dae77-34d4-4409-82fb-ca7576f89226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c79e0de-f7f6-4653-8203-fe1dabf5e66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c79e0de-f7f6-4653-8203-fe1dabf5e66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-493206115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6ee98f-f305-4604-8444-5f8e26987005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8cc909b2ea48f89880d6d66b306b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:22Z,use_quota=True,user_id='10ce2aafa5f444c6af6e1f043b111fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59aabbf1-6770-4a3b-b1fb-2183f8e92fee),volume_type_id=59aabbf1-6770-4a3b-b1fb-2183f8e92fee)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04606c7a-e1a7-46ed-b8a8-4552f42ba253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04606c7a-e1a7-46ed-b8a8-4552f42ba253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaaabe9-86e0-4fd8-b7ba-112737a978fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaaabe9-86e0-4fd8-b7ba-112737a978fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6ee98f-f305-4604-8444-5f8e26987005', 'volume_name': 'volume-ae6ee98f-f305-4604-8444-5f8e26987005', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2850829e-1bbb-4a47-a028-74d3f985e365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2850829e-1bbb-4a47-a028-74d3f985e365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb9088d-2aee-46b5-9858-c76d9981be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Volume ae6ee98f-f305-4604-8444-5f8e26987005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6ee98f-f305-4604-8444-5f8e26987005', 'volume_size': 1} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-493206115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6ee98f-f305-4604-8444-5f8e26987005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8cc909b2ea48f89880d6d66b306b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:22Z,use_quota=True,user_id='10ce2aafa5f444c6af6e1f043b111fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59aabbf1-6770-4a3b-b1fb-2183f8e92fee),volume_type_id=59aabbf1-6770-4a3b-b1fb-2183f8e92fee)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Creating volume ae6ee98f-f305-4604-8444-5f8e26987005 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:33:22 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:22 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 1073741824 Nov 02 14:33:22 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Flow 'volume_create_manager' (fdf2ba6a-2cb3-48d3-a5de-e1faae6d3cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d46f36-ddb5-4415-9454-f246f8e5c102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d46f36-ddb5-4415-9454-f246f8e5c102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1767412681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38027ba9-bf7a-44cd-ac9d-bbb63614fe83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8cc909b2ea48f89880d6d66b306b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:23Z,use_quota=True,user_id='10ce2aafa5f444c6af6e1f043b111fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78a628e8-d70e-41cc-a690-45da8f72a9bd),volume_type_id=78a628e8-d70e-41cc-a690-45da8f72a9bd)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf3d9b7-1cb9-4536-9ce8-9bf8e8a55875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf3d9b7-1cb9-4536-9ce8-9bf8e8a55875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5103feb-c93f-4d2d-a5bd-719bc3717a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5103feb-c93f-4d2d-a5bd-719bc3717a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38027ba9-bf7a-44cd-ac9d-bbb63614fe83', 'volume_name': 'volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7be4cb-605c-4ad9-bfa5-817a89acf994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7be4cb-605c-4ad9-bfa5-817a89acf994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0411cc91-30b4-4fee-9ce2-e2327ef5f54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Volume 38027ba9-bf7a-44cd-ac9d-bbb63614fe83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83', 'volume_size': 1} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:33:22 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Flow 'volume_create_manager' (e1c60e34-1785-4d73-83b5-e076e10d6d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fede361-36a0-4a02-b65e-2b400b2d4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 1073741824" returned: 0 in 0.645s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fede361-36a0-4a02-b65e-2b400b2d4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1655630152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5853e84a-3a72-4119-86c9-275856c39295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e7572be659418987675d2a07bc4097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:23Z,use_quota=True,user_id='c4aec083d9ca436890f1b065e08b2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12910549-25a5-4292-a612-83ee8042c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12910549-25a5-4292-a612-83ee8042c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33037da-1a08-4199-9439-876b7b7eb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33037da-1a08-4199-9439-876b7b7eb04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5853e84a-3a72-4119-86c9-275856c39295', 'volume_name': 'volume-5853e84a-3a72-4119-86c9-275856c39295', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565e780b-5c12-471f-a82c-27a97b01c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565e780b-5c12-471f-a82c-27a97b01c45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0db35a-3812-4f08-9e74-4c35fca7291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Volume 5853e84a-3a72-4119-86c9-275856c39295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5853e84a-3a72-4119-86c9-275856c39295', 'volume_size': 1} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:23 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 Nov 02 14:33:23 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Flow 'volume_create_manager' (158a5769-1b03-4da9-a7e5-bc1312bca001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a9b076-07ba-4e9b-b187-813d39ff5423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a9b076-07ba-4e9b-b187-813d39ff5423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1909599105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae9b332-060b-4768-b3b6-0bfbe0725901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8cc909b2ea48f89880d6d66b306b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:23Z,use_quota=True,user_id='10ce2aafa5f444c6af6e1f043b111fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8762c44c-b8f1-4bda-960f-b6329ab4d1e3),volume_type_id=8762c44c-b8f1-4bda-960f-b6329ab4d1e3)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a56c132-6db4-410b-8b7d-ced20702769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a56c132-6db4-410b-8b7d-ced20702769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe8f395-f659-48e2-83a0-950ffbb4caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005" returned: 0 in 0.280s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1767412681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38027ba9-bf7a-44cd-ac9d-bbb63614fe83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8cc909b2ea48f89880d6d66b306b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:23Z,use_quota=True,user_id='10ce2aafa5f444c6af6e1f043b111fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78a628e8-d70e-41cc-a690-45da8f72a9bd),volume_type_id=78a628e8-d70e-41cc-a690-45da8f72a9bd)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Creating volume 38027ba9-bf7a-44cd-ac9d-bbb63614fe83 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:33:23 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb9088d-2aee-46b5-9858-c76d9981be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6ee98f-f305-4604-8444-5f8e26987005', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 1073741824 Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2e09e4-2a7b-4c59-ba32-58abc8dcbba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Volume volume-ae6ee98f-f305-4604-8444-5f8e26987005 (ae6ee98f-f305-4604-8444-5f8e26987005): created successfully Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2e09e4-2a7b-4c59-ba32-58abc8dcbba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Flow 'volume_create_manager' (709dae77-34d4-4409-82fb-ca7576f89226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9e18a671-e49e-4692-8940-6a1c8bfc34bd tempest-TestInstancesWithCinderVolumes-280149731 None] Created volume successfully. Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe8f395-f659-48e2-83a0-950ffbb4caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ae9b332-060b-4768-b3b6-0bfbe0725901', 'volume_name': 'volume-0ae9b332-060b-4768-b3b6-0bfbe0725901', 'volume_size': 1, 'image_id': 'f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--685192130', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b8cc909b2ea48f89880d6d66b306b17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'created_at': datetime.datetime(2026, 11, 2, 13, 33, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 33, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3/file', 'properties': {}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8ca997-be22-461b-b46a-892c7407824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8ca997-be22-461b-b46a-892c7407824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc25d7-f9af-47e6-93c0-ddd641becd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Volume 0ae9b332-060b-4768-b3b6-0bfbe0725901: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ae9b332-060b-4768-b3b6-0bfbe0725901', 'volume_size': 1, 'image_id': 'f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--685192130', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b8cc909b2ea48f89880d6d66b306b17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'created_at': datetime.datetime(2026, 11, 2, 13, 33, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 33, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3/file', 'properties': {}}, 'image_service': } Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Trying to clone 0ae9b332-060b-4768-b3b6-0bfbe0725901 from image f56a9e1c-6f03-4e42-9f79-202c61709ff3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:33:23 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 1073741824" returned: 0 in 0.452s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:23 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 Nov 02 14:33:23 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:24 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83" returned: 0 in 0.261s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1655630152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5853e84a-3a72-4119-86c9-275856c39295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e7572be659418987675d2a07bc4097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:23Z,use_quota=True,user_id='c4aec083d9ca436890f1b065e08b2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Creating volume 5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:33:24 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0411cc91-30b4-4fee-9ce2-e2327ef5f54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0784539a-a803-449e-95a2-bbccbb070e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:24 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 1073741824 Nov 02 14:33:24 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:24 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Volume volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 (38027ba9-bf7a-44cd-ac9d-bbb63614fe83): created successfully Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0784539a-a803-449e-95a2-bbccbb070e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Flow 'volume_create_manager' (fdf2ba6a-2cb3-48d3-a5de-e1faae6d3cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:24 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-bef98fb1-54b9-489f-90b5-7bda1e34ef4f tempest-TestInstancesWithCinderVolumes-280149731 None] Created volume successfully. Nov 02 14:33:24 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 1073741824" returned: 0 in 0.488s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:24 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 Nov 02 14:33:24 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:24 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295" returned: 0 in 0.275s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b0db35a-3812-4f08-9e74-4c35fca7291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5853e84a-3a72-4119-86c9-275856c39295', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea753413-c7e1-44d0-8d90-767695650ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:24 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Volume volume-5853e84a-3a72-4119-86c9-275856c39295 (5853e84a-3a72-4119-86c9-275856c39295): created successfully Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea753413-c7e1-44d0-8d90-767695650ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Flow 'volume_create_manager' (e1c60e34-1785-4d73-83b5-e076e10d6d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9637c06f-fc3b-4141-a758-4db0eddc893d tempest-VolumesDeleteCascade-1163480752 None] Created volume successfully. Nov 02 14:33:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Creating offline snapshot d69f23cf-8681-431a-9537-6bd2b15781ea of volume 5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:33:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0666ccb0-42bb-4f83-a12a-ae8fc34b74dc]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:26 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 Nov 02 14:33:26 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:26 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:26 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea 1G Nov 02 14:33:26 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:26 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea 1G" returned: 0 in 0.451s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5853e84a-3a72-4119-86c9-275856c39295 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:26 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5853e84a-3a72-4119-86c9-275856c39295 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea Nov 02 14:33:26 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:27 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD, size 20.69 MB, duration 3.45 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:33:27 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Image download 20.69 MB at 6.00 MB/s Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5853e84a-3a72-4119-86c9-275856c39295 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea" returned: 0 in 0.340s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:27 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea is being set with open permissions: ugo+rw Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:27 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea Nov 02 14:33:27 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[328feb8a-1459-4124-b2fd-51b99527c087]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:27 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD Nov 02 14:33:27 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:27 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea" returned: 0 in 0.256s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:27 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.info Nov 02 14:33:27 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:27 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Temporary image f56a9e1c-6f03-4e42-9f79-202c61709ff3 is fetched for user 10ce2aafa5f444c6af6e1f043b111fe0. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb5654c-08c0-4d1f-8ca6-1ea975c71f64]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:27 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.info" returned: 0 in 0.261s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:27 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.info is being set with open permissions: ugo+rw Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:27 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.info Nov 02 14:33:27 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:27 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD Nov 02 14:33:27 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:27 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.info" returned: 0 in 0.258s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:27 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1909599105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae9b332-060b-4768-b3b6-0bfbe0725901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8cc909b2ea48f89880d6d66b306b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:23Z,use_quota=True,user_id='10ce2aafa5f444c6af6e1f043b111fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8762c44c-b8f1-4bda-960f-b6329ab4d1e3),volume_type_id=8762c44c-b8f1-4bda-960f-b6329ab4d1e3)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Creating volume 0ae9b332-060b-4768-b3b6-0bfbe0725901 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:33:28 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:28 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 1073741824 Nov 02 14:33:28 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-09b399c4-a082-4f83-a094-11a862f5cbda tempest-VolumesDeleteCascade-1163480752 None] Create snapshot completed successfully Nov 02 14:33:28 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 1073741824" returned: 0 in 0.407s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:28 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 Nov 02 14:33:28 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:28 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901" returned: 0 in 0.245s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Attempting download of f56a9e1c-6f03-4e42-9f79-202c61709ff3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'metadata': {}}])) to volume 0ae9b332-060b-4768-b3b6-0bfbe0725901. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b9ccdf-97f3-4f46-a9c1-210131852040]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f56a9e1c-6f03-4e42-9f79-202c61709ff3_ym2b30av {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:28 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f56a9e1c-6f03-4e42-9f79-202c61709ff3_ym2b30av Nov 02 14:33:28 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:29 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f56a9e1c-6f03-4e42-9f79-202c61709ff3_ym2b30av" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56a9e1c-6f03-4e42-9f79-202c61709ff3_ym2b30av {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:29 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56a9e1c-6f03-4e42-9f79-202c61709ff3_ym2b30av Nov 02 14:33:29 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Creating offline snapshot 483e6135-b095-4b84-874b-523d6d5d29fd of volume 5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b0c57-e900-4c29-b2f0-30836ebb70d0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:29 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea Nov 02 14:33:29 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:29 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56a9e1c-6f03-4e42-9f79-202c61709ff3_ym2b30av" returned: 1 in 0.342s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f56a9e1c-6f03-4e42-9f79-202c61709ff3_ym2b30av' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d72a32-2428-4264-8274-ce16de1d9390]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:29 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD Nov 02 14:33:29 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:29 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5853e84a-3a72-4119-86c9-275856c39295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:29 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd 1G Nov 02 14:33:29 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:29 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] f56a9e1c-6f03-4e42-9f79-202c61709ff3 was qcow2, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:33:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:29 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 Nov 02 14:33:29 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:30 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd 1G" returned: 0 in 0.446s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:30 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd Nov 02 14:33:30 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:30 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd" returned: 0 in 0.340s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:30 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd is being set with open permissions: ugo+rw Nov 02 14:33:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:30 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd Nov 02 14:33:30 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:30 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd" returned: 0 in 0.331s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.601s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:30 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f4445a08-2f79-4d8b-a2eb-f81e3b7391c0 tempest-VolumesDeleteCascade-1163480752 None] Create snapshot completed successfully Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-5853e84a-3a72-4119-86c9-275856c39295-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-5853e84a-3a72-4119-86c9-275856c39295-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Performing cascade delete. {{(pid=86978) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-483e6135-b095-4b84-874b-523d6d5d29fd-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-483e6135-b095-4b84-874b-523d6d5d29fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-483e6135-b095-4b84-874b-523d6d5d29fd" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-483e6135-b095-4b84-874b-523d6d5d29fd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Deleting offline snapshot 483e6135-b095-4b84-874b-523d6d5d29fd of volume 5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] snapshot_file for this snap is: volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a4219-4d67-4376-ae94-a372f0f7566b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:31 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd Nov 02 14:33:31 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:31 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901" returned: 0 in 2.145s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f56a9e1c-6f03-4e42-9f79-202c61709ff3_dx5158vzdevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:33:31 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Converted 112.00 MB image at 52.17 MB/s Nov 02 14:33:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:31 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 1G Nov 02 14:33:31 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:32 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd" returned: 0 in 0.470s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5853e84a-3a72-4119-86c9-275856c39295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e64b87-1589-46b5-9a16-6e81fb065798]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:32 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea Nov 02 14:33:32 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:32 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 1G" returned: 0 in 0.344s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Downloaded image f56a9e1c-6f03-4e42-9f79-202c61709ff3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'metadata': {}}])) to volume 0ae9b332-060b-4768-b3b6-0bfbe0725901 successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Temporary image f56a9e1c-6f03-4e42-9f79-202c61709ff3 for user 10ce2aafa5f444c6af6e1f043b111fe0 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Marking volume 0ae9b332-060b-4768-b3b6-0bfbe0725901 as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Copying metadata from image f56a9e1c-6f03-4e42-9f79-202c61709ff3 to 0ae9b332-060b-4768-b3b6-0bfbe0725901. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Creating volume glance metadata for volume 0ae9b332-060b-4768-b3b6-0bfbe0725901 backed by image f56a9e1c-6f03-4e42-9f79-202c61709ff3 with: {'image_id': 'f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'image_name': 'tempest-scenario-img--685192130', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc25d7-f9af-47e6-93c0-ddd641becd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae9b332-060b-4768-b3b6-0bfbe0725901', 'volume_size': 1, 'image_id': 'f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--685192130', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b8cc909b2ea48f89880d6d66b306b17', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f56a9e1c-6f03-4e42-9f79-202c61709ff3', 'created_at': datetime.datetime(2026, 11, 2, 13, 33, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 33, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f56a9e1c-6f03-4e42-9f79-202c61709ff3/file', 'properties': {}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064019aa-ee22-42fc-a5b8-5315a9646777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:32 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Volume volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 (0ae9b332-060b-4768-b3b6-0bfbe0725901): created successfully Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064019aa-ee22-42fc-a5b8-5315a9646777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Flow 'volume_create_manager' (158a5769-1b03-4da9-a7e5-bc1312bca001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cffc0a96-2511-42e8-8d69-e078de658b88 tempest-TestInstancesWithCinderVolumes-280149731 None] Created volume successfully. Nov 02 14:33:32 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5853e84a-3a72-4119-86c9-275856c39295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:32 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd Nov 02 14:33:32 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:32 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd" returned: 0 in 0.415s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:33 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd Nov 02 14:33:33 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:33 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.483e6135-b095-4b84-874b-523d6d5d29fd" returned: 0 in 0.264s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-483e6135-b095-4b84-874b-523d6d5d29fd" released by "_delete_snapshot" :: held 1.679s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" released by "delete_snapshot" :: held 1.704s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Created reservations ['a6b87a16-7234-41d5-ba9e-723986d4c55c', 'd4517356-09d7-4cfd-b84d-ee42185bdb8b', 'd99d6700-827f-43d6-a25c-53d3984e3337', 'aab85b7b-13f9-4680-b281-0608409d72ac'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:33:33 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Delete snapshot completed successfully. Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-483e6135-b095-4b84-874b-523d6d5d29fd-delete_snapshot" released by "delete_snapshot" :: held 1.876s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-d69f23cf-8681-431a-9537-6bd2b15781ea-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-d69f23cf-8681-431a-9537-6bd2b15781ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-d69f23cf-8681-431a-9537-6bd2b15781ea" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-d69f23cf-8681-431a-9537-6bd2b15781ea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Deleting offline snapshot d69f23cf-8681-431a-9537-6bd2b15781ea of volume 5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] snapshot_file for this snap is: volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8db7d3-f58f-46c2-bb40-02a04e8b7519]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:33 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea Nov 02 14:33:33 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:34 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea" returned: 0 in 0.485s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5853e84a-3a72-4119-86c9-275856c39295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b43c24-9a66-405c-a98d-5420e37dd765]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:34 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 Nov 02 14:33:34 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:34 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295" returned: 0 in 0.499s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:34 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea Nov 02 14:33:34 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d5b69342-ce56-48d8-b72d-29ef203dde69 req-a208f8ee-bd44-46e9-beee-b9d3c34bbe17 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d5b69342-ce56-48d8-b72d-29ef203dde69 req-a208f8ee-bd44-46e9-beee-b9d3c34bbe17 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d5b69342-ce56-48d8-b72d-29ef203dde69 req-a208f8ee-bd44-46e9-beee-b9d3c34bbe17 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-d5b69342-ce56-48d8-b72d-29ef203dde69 req-a208f8ee-bd44-46e9-beee-b9d3c34bbe17 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd27b22f2-4df2-4266-852b-99f906940f77', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:33:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-d5b69342-ce56-48d8-b72d-29ef203dde69 req-a208f8ee-bd44-46e9-beee-b9d3c34bbe17 tempest-TestServerVolumeAttachmentScenario-1066677126 None] attachment_update completed successfully. Nov 02 14:33:35 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea" returned: 0 in 0.432s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:35 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea Nov 02 14:33:35 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:35 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295.d69f23cf-8681-431a-9537-6bd2b15781ea" returned: 0 in 0.336s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-d69f23cf-8681-431a-9537-6bd2b15781ea" released by "_delete_snapshot" :: held 1.950s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" released by "delete_snapshot" :: held 1.988s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Created reservations ['7ee7fa1a-0e36-4329-b5ed-d373e977c94d', 'e6842a3b-2dbe-4b5d-9988-9b76d37f9c03', '08f6e597-5d37-43e0-830a-589cc2a9709d', 'da8c7f20-4677-4a5e-b32c-57bfab981089'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:33:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Delete snapshot completed successfully. Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-d69f23cf-8681-431a-9537-6bd2b15781ea-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Snapshots deleted, issuing volume delete {{(pid=86978) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfb0cd6-a43f-4439-a60b-5b0dbc659157]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:35 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 Nov 02 14:33:35 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d82b5cc3-5089-4bc3-8eae-dae0bb2eb87c req-cfce824f-e754-4cfc-8b18-66bb3f5601fe tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d82b5cc3-5089-4bc3-8eae-dae0bb2eb87c req-cfce824f-e754-4cfc-8b18-66bb3f5601fe tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-d82b5cc3-5089-4bc3-8eae-dae0bb2eb87c req-cfce824f-e754-4cfc-8b18-66bb3f5601fe tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-d82b5cc3-5089-4bc3-8eae-dae0bb2eb87c req-cfce824f-e754-4cfc-8b18-66bb3f5601fe tempest-TestInstancesWithCinderVolumes-280149731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-0ae9b332-060b-4768-b3b6-0bfbe0725901', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2501c7fd-a4d7-4a78-887e-f0d39d3c810a', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:33:36 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-d82b5cc3-5089-4bc3-8eae-dae0bb2eb87c req-cfce824f-e754-4cfc-8b18-66bb3f5601fe tempest-TestInstancesWithCinderVolumes-280149731 None] attachment_update completed successfully. Nov 02 14:33:36 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295" returned: 0 in 0.489s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:36 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295 Nov 02 14:33:36 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:36 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5853e84a-3a72-4119-86c9-275856c39295" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-5853e84a-3a72-4119-86c9-275856c39295" released by "delete_volume" :: held 1.014s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Created reservations ['8a7a9647-8b13-4191-8215-bd2d678d56e0', '5ef91a38-f7dd-4d10-9730-951f3a5087c0', 'fc0ebdfd-16fd-4448-9a42-360855e221d7', '85365f7a-298a-48b8-aed9-43d63276e076'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:37 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:33:37 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:37 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.286s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:37 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:33:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Deleted volume successfully. Nov 02 14:33:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0256eccd-d73c-49ab-92cf-b2edf9d0394c tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-5853e84a-3a72-4119-86c9-275856c39295-delete_volume" released by "delete_volume" :: held 5.837s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:39 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:33:39 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Flow 'volume_create_manager' (e0cb3395-38a5-4b4a-8dae-904520d3264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6c191d-2a3f-4020-9a98-f5e0231c59c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6c191d-2a3f-4020-9a98-f5e0231c59c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-153177887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbcd94b-e6d2-48f3-b852-3ba4c2c4718c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e7572be659418987675d2a07bc4097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:39Z,use_quota=True,user_id='c4aec083d9ca436890f1b065e08b2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f025b132-1fcb-44fe-a9c1-f7ecabbfc319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f025b132-1fcb-44fe-a9c1-f7ecabbfc319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:39 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5b18fd-2dc5-4ebb-a285-139d523479a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5b18fd-2dc5-4ebb-a285-139d523479a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbcd94b-e6d2-48f3-b852-3ba4c2c4718c', 'volume_name': 'volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60910069-9d6a-4d18-99ac-ff81c841fe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60910069-9d6a-4d18-99ac-ff81c841fe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1147911-dc0c-4383-ab99-e89a955ba2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:39 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Volume edbcd94b-e6d2-48f3-b852-3ba4c2c4718c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c', 'volume_size': 1} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-153177887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbcd94b-e6d2-48f3-b852-3ba4c2c4718c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e7572be659418987675d2a07bc4097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:39Z,use_quota=True,user_id='c4aec083d9ca436890f1b065e08b2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Creating volume edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:33:39 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.682s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:33:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:33:39 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c 1073741824 Nov 02 14:33:39 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:40 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c 1073741824" returned: 0 in 0.783s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:40 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c Nov 02 14:33:40 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:41 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" returned: 0 in 0.429s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1147911-dc0c-4383-ab99-e89a955ba2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce92e3-1dd7-4139-8b39-0f8ed1427a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:41 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Volume volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c (edbcd94b-e6d2-48f3-b852-3ba4c2c4718c): created successfully Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce92e3-1dd7-4139-8b39-0f8ed1427a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Flow 'volume_create_manager' (e0cb3395-38a5-4b4a-8dae-904520d3264a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:41 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-61f954e6-b7cf-42db-ae5f-ad2b942a4bb3 tempest-VolumesDeleteCascade-1163480752 None] Created volume successfully. Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-2791d5c6-3d98-411b-bec5-4756a9733a59 req-b2e92030-4eb5-4697-b6cf-d0bb91c0b276 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-2791d5c6-3d98-411b-bec5-4756a9733a59 req-b2e92030-4eb5-4697-b6cf-d0bb91c0b276 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-2791d5c6-3d98-411b-bec5-4756a9733a59 req-b2e92030-4eb5-4697-b6cf-d0bb91c0b276 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-2791d5c6-3d98-411b-bec5-4756a9733a59 req-b2e92030-4eb5-4697-b6cf-d0bb91c0b276 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-69baf986-7627-40b6-b609-abe0a37370ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d36e3e2-b70a-4ad1-803c-d551ab8c3c6c', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:33:41 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-2791d5c6-3d98-411b-bec5-4756a9733a59 req-b2e92030-4eb5-4697-b6cf-d0bb91c0b276 tempest-TestServerVolumeAttachmentScenario-1066677126 None] attachment_update completed successfully. Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Creating offline snapshot eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a of volume edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c806939c-72b2-45ce-ba62-d90dc65b20f7]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:41 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c Nov 02 14:33:41 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:42 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" returned: 0 in 0.558s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:42 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a 1G Nov 02 14:33:42 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:42 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a 1G" returned: 0 in 0.509s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:42 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a Nov 02 14:33:42 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:43 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" returned: 0 in 0.448s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:43 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a is being set with open permissions: ugo+rw Nov 02 14:33:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:43 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a Nov 02 14:33:43 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:43 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" returned: 0 in 0.514s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:43 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.info Nov 02 14:33:43 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-99d4f382-498a-4af5-bea4-0d2c0b4420ea req-92858ca4-6728-4634-9de4-78e676523d72 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Terminate volume connection completed successfully. Nov 02 14:33:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-99d4f382-498a-4af5-bea4-0d2c0b4420ea req-92858ca4-6728-4634-9de4-78e676523d72 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Deleting attachment 5d36e3e2-b70a-4ad1-803c-d551ab8c3c6c. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:33:44 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.info" returned: 0 in 0.421s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:44 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.info is being set with open permissions: ugo+rw Nov 02 14:33:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:44 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.info Nov 02 14:33:44 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:44 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.info" returned: 0 in 0.370s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-28b21ae3-26fb-4663-ac78-821ae2419802 tempest-VolumesDeleteCascade-1163480752 None] Create snapshot completed successfully Nov 02 14:33:45 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:33:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Flow 'volume_create_manager' (f01dc480-7df9-4070-8b51-26e76b821f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a67b890-a661-4782-af93-1a61c5562209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a67b890-a661-4782-af93-1a61c5562209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1660193567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d03f76-4962-4ee4-b5a2-57fcea38b87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e7572be659418987675d2a07bc4097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:33:46Z,use_quota=True,user_id='c4aec083d9ca436890f1b065e08b2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9224a2db-d0bd-47e5-a035-6636cd613cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9224a2db-d0bd-47e5-a035-6636cd613cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafbdca3-e655-4e5d-9b10-e23b8b2ccfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eafbdca3-e655-4e5d-9b10-e23b8b2ccfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd6d03f76-4962-4ee4-b5a2-57fcea38b87c', 'volume_name': 'volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c', 'volume_size': 1, 'snapshot_id': 'eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1832b9-ea94-45e0-9caa-9be0b09b5708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1832b9-ea94-45e0-9caa-9be0b09b5708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c7813e-15bb-41ae-a5df-0bea23c60516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:46 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Volume d6d03f76-4962-4ee4-b5a2-57fcea38b87c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c', 'volume_size': 1, 'snapshot_id': 'eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a'} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-b6eb222b-b937-4893-824c-9e19da23d633 req-f102014d-8fef-4ce5-86e9-94e2f9b474fc tempest-TestServerVolumeAttachmentScenario-1066677126 None] Terminate volume connection completed successfully. Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-b6eb222b-b937-4893-824c-9e19da23d633 req-f102014d-8fef-4ce5-86e9-94e2f9b474fc tempest-TestServerVolumeAttachmentScenario-1066677126 None] Deleting attachment d27b22f2-4df2-4266-852b-99f906940f77. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Creating volume d6d03f76-4962-4ee4-b5a2-57fcea38b87c from snapshot eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] snapshot: eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a, volume: d6d03f76-4962-4ee4-b5a2-57fcea38b87c, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f892da37-dc48-481a-bbb2-f40d00457a4b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:46 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a Nov 02 14:33:46 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:47 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" returned: 0 in 0.879s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:33:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[197aeca2-9211-4f5d-9d5b-bf5cbe5ffe50]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:47 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c Nov 02 14:33:47 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:48 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" returned: 0 in 0.718s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:33:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:33:48 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:33:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:48 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c Nov 02 14:33:48 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "cinder-69baf986-7627-40b6-b609-abe0a37370ff-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-69baf986-7627-40b6-b609-abe0a37370ff-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=60,cinder:SELECT=72,cinder:DELETE=8,cinder:INSERT=24 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=95,cinder:UPDATE=68,cinder:INSERT=24,cinder:DELETE=5 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "cinder-quobyte-69baf986-7627-40b6-b609-abe0a37370ff" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-quobyte-69baf986-7627-40b6-b609-abe0a37370ff" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be48f6-c25a-4786-a9cc-da57b2595add]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:56 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff Nov 02 14:33:56 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:56 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff" returned: 0 in 0.837s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:56 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff Nov 02 14:33:56 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:57 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-69baf986-7627-40b6-b609-abe0a37370ff" returned: 0 in 0.517s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-quobyte-69baf986-7627-40b6-b609-abe0a37370ff" released by "delete_volume" :: held 1.476s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Created reservations ['69cf09d3-2284-46ee-bd7a-160e9f494442', '14692556-a0ca-4312-9d2f-2dc5edfb6eda', 'fecf7a1f-5d03-4b45-b194-acf692a810d8', '9d5b1036-744d-4ff6-8701-cc2a6859e06e'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:57 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:33:57 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:57 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.349s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:33:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Deleted volume successfully. Nov 02 14:33:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d2fde88e-e501-44cb-88f8-e2c891fc76a0 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-69baf986-7627-40b6-b609-abe0a37370ff-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "cinder-09b31f75-1b80-40e2-b85a-da7bfe375fbc-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-09b31f75-1b80-40e2-b85a-da7bfe375fbc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "cinder-quobyte-09b31f75-1b80-40e2-b85a-da7bfe375fbc" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-quobyte-09b31f75-1b80-40e2-b85a-da7bfe375fbc" acquired by "delete_volume" :: waited 0.053s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20d76d-bd3c-4bfc-a0e8-d8bb53b88004]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:58 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc Nov 02 14:33:58 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:58 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" returned: 0 in 10.697s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c, size 1024.00 MB, duration 10.70 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:33:58 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Converted 1024.00 MB image at 95.72 MB/s Nov 02 14:33:58 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c is being set with open permissions: ugo+rw Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:58 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c Nov 02 14:33:58 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:58 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc" returned: 0 in 0.606s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:58 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc Nov 02 14:33:58 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:59 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" returned: 0 in 0.267s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" released by "_copy_volume_from_snapshot" :: held 12.788s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" released by "_create_volume_from_snapshot" :: held 12.912s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.961s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c7813e-15bb-41ae-a5df-0bea23c60516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c', 'volume_size': 1, 'snapshot_id': 'eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:59 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f692f845-7b23-44b0-a4cf-270f8fa854e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-09b31f75-1b80-40e2-b85a-da7bfe375fbc" returned: 0 in 0.292s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:59 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Volume volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c (d6d03f76-4962-4ee4-b5a2-57fcea38b87c): created successfully Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f692f845-7b23-44b0-a4cf-270f8fa854e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Flow 'volume_create_manager' (f01dc480-7df9-4070-8b51-26e76b821f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-quobyte-09b31f75-1b80-40e2-b85a-da7bfe375fbc" released by "delete_volume" :: held 1.012s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:59 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-634b81c5-38c8-49d4-a3bd-1aad267e41c4 tempest-VolumesDeleteCascade-1163480752 None] Created volume successfully. Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Created reservations ['dc02e4a5-d1cd-458f-abfa-ea2233131038', 'bfed4779-9477-4b15-aa9e-d87954c51b8b', '9b369cd0-8bc0-405c-8b06-1f9f98ff0cb4', 'f85ffba6-c27b-4541-872a-d721fbc51e25'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:33:59 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:33:59 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:33:59 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.240s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:33:59 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Deleted volume successfully. Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-25b1a79c-739f-4278-bf70-d55d89c1b427 tempest-TestServerVolumeAttachmentScenario-1066677126 None] Lock "cinder-09b31f75-1b80-40e2-b85a-da7bfe375fbc-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Performing cascade delete. {{(pid=86978) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Deleting offline snapshot eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a of volume edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] snapshot_file for this snap is: volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7576fa-24aa-41da-b3bf-6f48adf853e0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:33:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:00 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a Nov 02 14:34:00 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:00 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:00 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd72107-5893-478e-a2da-a7ba0506f84e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:00 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c Nov 02 14:34:00 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:00 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" returned: 0 in 0.513s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:00 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a Nov 02 14:34:00 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:01 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" returned: 0 in 0.371s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:01 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a Nov 02 14:34:01 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:01 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c.eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" returned: 0 in 0.262s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a" released by "_delete_snapshot" :: held 1.605s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" released by "delete_snapshot" :: held 1.625s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Created reservations ['b04dbce5-bb7f-4fec-b309-c40c877cb327', 'dacbedbc-0a8d-4523-af5a-937f6badc06f', 'f05c5bd6-e9a8-44ed-834a-3109520130b4', '04177acf-bb80-4ad6-be44-165f00343e97'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:01 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Delete snapshot completed successfully. Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-eb61ee0f-e7d1-46e9-8d10-ff151e6e1a2a-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Snapshots deleted, issuing volume delete {{(pid=86978) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec428c53-c3f2-4d93-a240-e9715e1befe1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:01 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c Nov 02 14:34:01 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:02 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" returned: 0 in 0.373s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:02 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c Nov 02 14:34:02 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:02 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" returned: 0 in 0.261s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c" released by "delete_volume" :: held 0.699s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Created reservations ['8e0d3e66-980a-4976-8fb9-5b33964840e1', 'a63bb5b3-0f72-4acd-9522-6887d74b463b', 'c18eaa4f-7bc4-4ff0-b16e-62cd9d398c81', '3df39828-c081-4c4e-b7d4-75cde8ae98ca'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:02 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:02 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:02 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Deleted volume successfully. Nov 02 14:34:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7caf27bd-f952-42c2-9dc1-63cbab31dbdb tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-edbcd94b-e6d2-48f3-b852-3ba4c2c4718c-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-d6d03f76-4962-4ee4-b5a2-57fcea38b87c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-d6d03f76-4962-4ee4-b5a2-57fcea38b87c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "cinder-quobyte-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" acquired by "delete_volume" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1828c1-7b9f-4080-abc1-fe172359ad0e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:03 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c Nov 02 14:34:03 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:03 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:03 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c Nov 02 14:34:03 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:04 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" returned: 0 in 0.273s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-quobyte-d6d03f76-4962-4ee4-b5a2-57fcea38b87c" released by "delete_volume" :: held 0.751s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Created reservations ['39458466-093c-4790-bc04-e0e45421aea1', '5becde3c-6038-415c-9607-f8bee068da1a', 'c3a9e147-6dfc-460b-ac13-ca5695f66353', '5193079c-7002-4033-b3f3-08ace7937e01'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:04 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:04 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:04 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.311s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Deleted volume successfully. Nov 02 14:34:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b605f96e-0cdb-42c6-94fb-d78238e524b1 tempest-VolumesDeleteCascade-1163480752 None] Lock "cinder-d6d03f76-4962-4ee4-b5a2-57fcea38b87c-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Flow 'volume_create_manager' (df482589-1d0d-406b-917b-fcc0d0bae682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ecbfd0-4808-4d70-bb97-fbabce59e223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ecbfd0-4808-4d70-bb97-fbabce59e223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1472696892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805360e1-5f1e-4a05-8b05-c57eb8a4692f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea2dbc8b9324480a12889e78a473ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:09Z,use_quota=True,user_id='a34ab4d0d3fb474bad66138c453c9fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac14580-ef3e-459a-bed5-98ef1685d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac14580-ef3e-459a-bed5-98ef1685d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fd8d99-1aa5-4d46-af56-e4054d6700df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fd8d99-1aa5-4d46-af56-e4054d6700df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805360e1-5f1e-4a05-8b05-c57eb8a4692f', 'volume_name': 'volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3e3ae6-baf9-4dc3-9cf8-a6c0a0163ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3e3ae6-baf9-4dc3-9cf8-a6c0a0163ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b855bc5-5fda-46ad-9ea5-29dd42d0fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:08 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f', 'volume_size': 1} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1472696892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805360e1-5f1e-4a05-8b05-c57eb8a4692f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea2dbc8b9324480a12889e78a473ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:09Z,use_quota=True,user_id='a34ab4d0d3fb474bad66138c453c9fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Creating volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:08 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:08 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f 1073741824 Nov 02 14:34:08 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-a3f17c9b-83d7-4144-86d5-e36a2cc9200b req-a0f1073a-d906-40d8-8bb6-03f3d37c34bb tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:09 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f 1073741824" returned: 0 in 0.622s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:09 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f Nov 02 14:34:09 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:09 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-a3f17c9b-83d7-4144-86d5-e36a2cc9200b req-a0f1073a-d906-40d8-8bb6-03f3d37c34bb tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.427s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-a3f17c9b-83d7-4144-86d5-e36a2cc9200b req-a0f1073a-d906-40d8-8bb6-03f3d37c34bb tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b855bc5-5fda-46ad-9ea5-29dd42d0fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e18129-6d2a-49e0-a73a-03fa0dfbce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:09 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Volume volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f (805360e1-5f1e-4a05-8b05-c57eb8a4692f): created successfully Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e18129-6d2a-49e0-a73a-03fa0dfbce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Flow 'volume_create_manager' (df482589-1d0d-406b-917b-fcc0d0bae682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3d58fc9c-9473-479c-bdea-fbe00aae8450 tempest-VolumesSnapshotListTestJSON-281416278 None] Created volume successfully. Nov 02 14:34:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-a3f17c9b-83d7-4144-86d5-e36a2cc9200b req-a0f1073a-d906-40d8-8bb6-03f3d37c34bb tempest-TestInstancesWithCinderVolumes-280149731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-ae6ee98f-f305-4604-8444-5f8e26987005', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a11240e-b738-4ef7-9e1a-da23721cb3ec', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:34:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-a3f17c9b-83d7-4144-86d5-e36a2cc9200b req-a0f1073a-d906-40d8-8bb6-03f3d37c34bb tempest-TestInstancesWithCinderVolumes-280149731 None] attachment_update completed successfully. Nov 02 14:34:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Creating offline snapshot 538a5a7d-74e4-4103-95a4-4919c94ebeb4 of volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:34:10 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d1a397-757f-40cb-9eca-b6d99852029c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:11 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f Nov 02 14:34:11 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:11 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:11 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 1G Nov 02 14:34:11 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:11 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 1G" returned: 0 in 0.506s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:11 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 Nov 02 14:34:11 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:12 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4" returned: 0 in 0.405s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:12 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 is being set with open permissions: ugo+rw Nov 02 14:34:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:12 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 Nov 02 14:34:12 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c68b442b-63c4-4925-9f74-7d65121d74b5 req-28502078-2436-4579-9026-8f7bf7fe65c3 tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:12 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:12 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.info Nov 02 14:34:12 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:12 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.info" returned: 0 in 0.257s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:12 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.info is being set with open permissions: ugo+rw Nov 02 14:34:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:12 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.info Nov 02 14:34:12 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:13 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.info" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c68b442b-63c4-4925-9f74-7d65121d74b5 req-28502078-2436-4579-9026-8f7bf7fe65c3 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.748s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c68b442b-63c4-4925-9f74-7d65121d74b5 req-28502078-2436-4579-9026-8f7bf7fe65c3 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3dab8ce1-7e86-4b14-92a1-a6dc261a52c3 tempest-VolumesSnapshotListTestJSON-281416278 None] Create snapshot completed successfully Nov 02 14:34:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-c68b442b-63c4-4925-9f74-7d65121d74b5 req-28502078-2436-4579-9026-8f7bf7fe65c3 tempest-TestInstancesWithCinderVolumes-280149731 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50a28fcc-4085-47bc-a0ff-f0f0521685f3', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:34:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-c68b442b-63c4-4925-9f74-7d65121d74b5 req-28502078-2436-4579-9026-8f7bf7fe65c3 tempest-TestInstancesWithCinderVolumes-280149731 None] attachment_update completed successfully. Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Creating offline snapshot 67387bca-21ba-4f80-a00d-6ff9a0a24373 of volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39d50ab-03e6-4023-bb88-4cd2ae4fb38b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:14 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 Nov 02 14:34:14 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:14 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4" returned: 0 in 0.410s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:14 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 1G Nov 02 14:34:14 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:15 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 1G" returned: 0 in 0.529s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:15 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 Nov 02 14:34:15 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:15 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373" returned: 0 in 0.323s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:15 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 is being set with open permissions: ugo+rw Nov 02 14:34:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:15 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 Nov 02 14:34:15 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:15 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373" returned: 0 in 0.268s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.675s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1b9996c0-9e10-4fbd-a475-f196d3d6a5b2 tempest-VolumesSnapshotListTestJSON-281416278 None] Create snapshot completed successfully Nov 02 14:34:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Creating offline snapshot b86adb5f-59cb-4370-8bfd-b74050a9e7b1 of volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:34:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[09926637-ccb1-4023-897b-5963919fae2f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:16 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 Nov 02 14:34:16 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:17 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373" returned: 0 in 0.527s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:17 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 1G Nov 02 14:34:17 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:17 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 1G" returned: 0 in 0.551s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:17 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 Nov 02 14:34:17 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:18 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:18 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 is being set with open permissions: ugo+rw Nov 02 14:34:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:18 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 Nov 02 14:34:18 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:18 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1" returned: 0 in 0.348s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-12b3aa75-3419-48a8-9837-cb7d8804ac9f tempest-VolumesSnapshotListTestJSON-281416278 None] Create snapshot completed successfully Nov 02 14:34:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-e6c4f35c-b1b0-4f9e-b933-3b0892897e95 req-ed0fb930-d11a-4534-b061-d0f6085acb7e tempest-TestInstancesWithCinderVolumes-280149731 None] Terminate volume connection completed successfully. Nov 02 14:34:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-e6c4f35c-b1b0-4f9e-b933-3b0892897e95 req-ed0fb930-d11a-4534-b061-d0f6085acb7e tempest-TestInstancesWithCinderVolumes-280149731 None] Deleting attachment 1a11240e-b738-4ef7-9e1a-da23721cb3ec. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "cinder-ae6ee98f-f305-4604-8444-5f8e26987005-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-ae6ee98f-f305-4604-8444-5f8e26987005-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "cinder-quobyte-ae6ee98f-f305-4604-8444-5f8e26987005" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-quobyte-ae6ee98f-f305-4604-8444-5f8e26987005" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7d1a3c-9374-4fbe-8dd8-c2e1e28e3873]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:19 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 Nov 02 14:34:19 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-b86adb5f-59cb-4370-8bfd-b74050a9e7b1-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-b86adb5f-59cb-4370-8bfd-b74050a9e7b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-quobyte-b86adb5f-59cb-4370-8bfd-b74050a9e7b1" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-b86adb5f-59cb-4370-8bfd-b74050a9e7b1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Deleting offline snapshot b86adb5f-59cb-4370-8bfd-b74050a9e7b1 of volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] snapshot_file for this snap is: volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce4fb39-2973-48bf-99e9-791aa6b60919]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:20 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005" returned: 0 in 0.494s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:20 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 Nov 02 14:34:20 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:20 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005 Nov 02 14:34:20 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:20 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1" returned: 0 in 0.479s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b32e72b-695a-40f8-b9ca-e8b228abfef3]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:20 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ae6ee98f-f305-4604-8444-5f8e26987005" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-quobyte-ae6ee98f-f305-4604-8444-5f8e26987005" released by "delete_volume" :: held 0.933s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:20 devstack cinder-volume[86978]: WARNING cinder.quota [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1946197632-74756353 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1946197632-74756353, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:34:20 devstack cinder-volume[86978]: WARNING cinder.quota [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1946197632-74756353 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1946197632-74756353, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Created reservations ['a747cf9f-42c8-4933-bc12-d2928ec16179', '9544f9e2-d8ef-4f22-9221-86ea35a5ea6e', '57e015cf-0982-494b-9cbd-8f6bb8bab23f', '31130fab-9112-49bf-80b2-6226490767b2'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:20 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 Nov 02 14:34:20 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:20 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:20 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:21 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.299s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Deleted volume successfully. Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33dbe8ff-fed4-4d3b-b0de-4a8f6ccf70ce tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-ae6ee98f-f305-4604-8444-5f8e26987005-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:21 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373" returned: 0 in 0.569s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:21 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 Nov 02 14:34:21 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:21 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1" returned: 0 in 0.470s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:21 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1 Nov 02 14:34:21 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:21 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.b86adb5f-59cb-4370-8bfd-b74050a9e7b1" returned: 0 in 0.294s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-b86adb5f-59cb-4370-8bfd-b74050a9e7b1" released by "_delete_snapshot" :: held 1.960s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" released by "delete_snapshot" :: held 1.996s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Created reservations ['2b583f45-f596-4e43-a153-806ef6e2c714', 'c04d8ff4-4750-4639-bb0e-b64aec96a676', '916b9d17-cea7-40a7-8ad1-7ea228608da7', '0d581c88-725a-4c29-a225-39c769ae4876'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Delete snapshot completed successfully. Nov 02 14:34:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-33d25fc4-ccc2-4a71-aca0-0b5a184ad85a tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-b86adb5f-59cb-4370-8bfd-b74050a9e7b1-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-67387bca-21ba-4f80-a00d-6ff9a0a24373-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-67387bca-21ba-4f80-a00d-6ff9a0a24373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-quobyte-67387bca-21ba-4f80-a00d-6ff9a0a24373" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-67387bca-21ba-4f80-a00d-6ff9a0a24373" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Deleting offline snapshot 67387bca-21ba-4f80-a00d-6ff9a0a24373 of volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] snapshot_file for this snap is: volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea71d02-fbf9-43aa-b3b3-17cf46085bf1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:23 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 Nov 02 14:34:23 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:23 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373" returned: 0 in 0.435s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ff507-4a57-4ee3-a0d9-3684b559c2c2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:23 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 Nov 02 14:34:23 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-4e18e7d0-7e2e-41fe-98bd-3556420d17fa req-43c23ec3-72a4-4226-b034-0ed45f772900 tempest-TestInstancesWithCinderVolumes-280149731 None] Terminate volume connection completed successfully. Nov 02 14:34:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-4e18e7d0-7e2e-41fe-98bd-3556420d17fa req-43c23ec3-72a4-4226-b034-0ed45f772900 tempest-TestInstancesWithCinderVolumes-280149731 None] Deleting attachment 50a28fcc-4085-47bc-a0ff-f0f0521685f3. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:34:24 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4" returned: 0 in 0.440s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:24 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 Nov 02 14:34:24 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:24 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373" returned: 0 in 0.491s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "cinder-38027ba9-bf7a-44cd-ac9d-bbb63614fe83-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-38027ba9-bf7a-44cd-ac9d-bbb63614fe83-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:24 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373 Nov 02 14:34:24 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "cinder-quobyte-38027ba9-bf7a-44cd-ac9d-bbb63614fe83" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-quobyte-38027ba9-bf7a-44cd-ac9d-bbb63614fe83" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faaa2fd-d4d8-4ab8-843d-28b958883115]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:25 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 Nov 02 14:34:25 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:25 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.67387bca-21ba-4f80-a00d-6ff9a0a24373" returned: 0 in 0.435s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-67387bca-21ba-4f80-a00d-6ff9a0a24373" released by "_delete_snapshot" :: held 1.937s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" released by "delete_snapshot" :: held 1.967s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Created reservations ['7137ae0e-2756-4eec-8128-d701df72d6b3', '3a47ce25-1761-452b-ba12-9ce79295b066', '190253c6-ec45-44ed-8a13-85b95c48da24', 'd2127a17-e5aa-4398-846b-bbf8212f91cd'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Delete snapshot completed successfully. Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-56a78ef3-746f-4ae3-94ad-830c7d1e6c45 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-67387bca-21ba-4f80-a00d-6ff9a0a24373-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:25 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83" returned: 0 in 0.478s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:25 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83 Nov 02 14:34:25 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:25 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-38027ba9-bf7a-44cd-ac9d-bbb63614fe83" returned: 0 in 0.261s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-quobyte-38027ba9-bf7a-44cd-ac9d-bbb63614fe83" released by "delete_volume" :: held 0.826s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:25 devstack cinder-volume[86978]: WARNING cinder.quota [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548190382-827091878 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548190382-827091878, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:34:25 devstack cinder-volume[86978]: WARNING cinder.quota [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548190382-827091878 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1548190382-827091878, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Created reservations ['2b0c7717-2850-4914-a2c3-72cd4f4a6b43', '298517af-694c-4958-b7eb-9aeb04fcfca3', '1f8a9e34-8fd1-4dfb-a579-8d7dabc64881', '93109180-c2f0-4ac6-901e-43dcecd720c4'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:25 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:25 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:26 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.285s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Deleted volume successfully. Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-53395c20-8a31-429a-9eb3-9f321bd7346f tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-38027ba9-bf7a-44cd-ac9d-bbb63614fe83-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-538a5a7d-74e4-4103-95a4-4919c94ebeb4-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-538a5a7d-74e4-4103-95a4-4919c94ebeb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-quobyte-538a5a7d-74e4-4103-95a4-4919c94ebeb4" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-538a5a7d-74e4-4103-95a4-4919c94ebeb4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Deleting offline snapshot 538a5a7d-74e4-4103-95a4-4919c94ebeb4 of volume 805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] snapshot_file for this snap is: volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1a373c-db62-449d-9343-5cad03ecf8ff]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:26 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 Nov 02 14:34:26 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:27 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4" returned: 0 in 0.501s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:27 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855b204-add5-4bba-8947-12fcd8510a82]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:27 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f Nov 02 14:34:27 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:27 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f" returned: 0 in 0.456s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:27 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 Nov 02 14:34:27 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:28 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4" returned: 0 in 0.510s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:28 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4 Nov 02 14:34:28 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:28 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f.538a5a7d-74e4-4103-95a4-4919c94ebeb4" returned: 0 in 0.438s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-538a5a7d-74e4-4103-95a4-4919c94ebeb4" released by "_delete_snapshot" :: held 2.138s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" released by "delete_snapshot" :: held 2.177s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:28 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Created reservations ['60001482-e6ec-435c-87e0-fa1511d0350d', '2974399e-ffb7-41b0-b122-517b1afed7d3', '49208540-9f1b-4d63-b7a8-891738242479', '4aa688a9-77e3-4bdd-9038-687703d5af5d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Delete snapshot completed successfully. Nov 02 14:34:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b75cb3de-5999-4e9b-8ccf-271a06314323 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-538a5a7d-74e4-4103-95a4-4919c94ebeb4-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-805360e1-5f1e-4a05-8b05-c57eb8a4692f-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-805360e1-5f1e-4a05-8b05-c57eb8a4692f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:30 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-f4efb0f0-e506-45e2-b13a-36e74578eca4 req-3f79fac5-4196-4260-9e7a-c6194ef3c05a tempest-TestInstancesWithCinderVolumes-280149731 None] Terminate volume connection completed successfully. Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-f4efb0f0-e506-45e2-b13a-36e74578eca4 req-3f79fac5-4196-4260-9e7a-c6194ef3c05a tempest-TestInstancesWithCinderVolumes-280149731 None] Deleting attachment 2501c7fd-a4d7-4a78-887e-f0d39d3c810a. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07e0bad-9d11-4d85-ae53-46e396eb0562]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:30 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f Nov 02 14:34:30 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:30 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f" returned: 0 in 0.538s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:30 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f Nov 02 14:34:30 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:30 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-805360e1-5f1e-4a05-8b05-c57eb8a4692f" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-quobyte-805360e1-5f1e-4a05-8b05-c57eb8a4692f" released by "delete_volume" :: held 0.905s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:30 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Created reservations ['c5b9d189-7290-4577-b3c0-71bc5016f2d0', '83b9ece7-ebf2-4c2d-aef1-36e18028b00f', '198e4015-1631-4d0f-8c58-88ab81f3671b', '1282e863-62e5-45aa-8683-ba9ef4ce4a84'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:31 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:31 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "cinder-0ae9b332-060b-4768-b3b6-0bfbe0725901-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-0ae9b332-060b-4768-b3b6-0bfbe0725901-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "cinder-quobyte-0ae9b332-060b-4768-b3b6-0bfbe0725901" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-quobyte-0ae9b332-060b-4768-b3b6-0bfbe0725901" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c767d0c-ea49-4cbe-9676-627db5db4730]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:31 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.347s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Deleted volume successfully. Nov 02 14:34:31 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 Nov 02 14:34:31 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5c0552c0-a32c-4d61-ba5e-3d4159aa25a4 tempest-VolumesSnapshotListTestJSON-281416278 None] Lock "cinder-805360e1-5f1e-4a05-8b05-c57eb8a4692f-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:31 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901" returned: 0 in 0.416s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:31 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901 Nov 02 14:34:31 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:32 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0ae9b332-060b-4768-b3b6-0bfbe0725901" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-quobyte-0ae9b332-060b-4768-b3b6-0bfbe0725901" released by "delete_volume" :: held 0.871s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:32 devstack cinder-volume[86978]: WARNING cinder.quota [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1213823895-919182232 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1213823895-919182232, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:34:32 devstack cinder-volume[86978]: WARNING cinder.quota [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1213823895-919182232 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1213823895-919182232, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Created reservations ['4749b5ae-fd77-4553-b8f1-20c17be06d2e', '27e50520-c0c8-44a7-b42e-8c98cf057931', '3777a872-034c-49df-b8f0-69b634b2d101', 'eb942d0c-b104-4c38-a7ba-27512f836d25'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:32 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:32 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:32 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.353s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Deleted volume successfully. Nov 02 14:34:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0884eb48-dc30-4df0-9dd6-021678ea0157 tempest-TestInstancesWithCinderVolumes-280149731 None] Lock "cinder-0ae9b332-060b-4768-b3b6-0bfbe0725901-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:35 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Flow 'volume_create_manager' (5550e8a4-9ab0-4c88-b0af-c97fe571c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496bf8e4-b476-4772-b79e-c73b9df627f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496bf8e4-b476-4772-b79e-c73b9df627f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1463638921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842ef3ce-1399-4a15-9703-5e94224f3523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07712b3b20b4d97ac1e8c9ac5378c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:36Z,use_quota=True,user_id='5fe9926364444395b1e10505cbc758dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743fdde1-733a-4e49-ba02-3f077c7cd847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743fdde1-733a-4e49-ba02-3f077c7cd847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3ceb41-e4bb-4bd6-9a6f-5cb02774949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3ceb41-e4bb-4bd6-9a6f-5cb02774949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842ef3ce-1399-4a15-9703-5e94224f3523', 'volume_name': 'volume-842ef3ce-1399-4a15-9703-5e94224f3523', 'volume_size': 2}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cd1a8f-b81f-4b53-b9e8-593f947a8268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cd1a8f-b81f-4b53-b9e8-593f947a8268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9311ceea-927f-446b-835f-fcf1ef4691f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Volume 842ef3ce-1399-4a15-9703-5e94224f3523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842ef3ce-1399-4a15-9703-5e94224f3523', 'volume_size': 2} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1463638921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842ef3ce-1399-4a15-9703-5e94224f3523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07712b3b20b4d97ac1e8c9ac5378c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:36Z,use_quota=True,user_id='5fe9926364444395b1e10505cbc758dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Creating volume 842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:36 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 2147483648 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:36 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 2147483648 Nov 02 14:34:36 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:36 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 2147483648" returned: 0 in 0.613s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:36 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 Nov 02 14:34:36 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:36 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523" returned: 0 in 0.257s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9311ceea-927f-446b-835f-fcf1ef4691f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842ef3ce-1399-4a15-9703-5e94224f3523', 'volume_size': 2}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b08ca0b-06be-4a86-b6ca-132b2b2876a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:37 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Volume volume-842ef3ce-1399-4a15-9703-5e94224f3523 (842ef3ce-1399-4a15-9703-5e94224f3523): created successfully Nov 02 14:34:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b08ca0b-06be-4a86-b6ca-132b2b2876a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Flow 'volume_create_manager' (5550e8a4-9ab0-4c88-b0af-c97fe571c2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ee37a06e-971b-4aca-98e7-bcf4f6f8635f tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Created volume successfully. Nov 02 14:34:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Creating offline snapshot d4084a4f-d452-4d79-a7ad-c477357ac694 of volume 842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:34:38 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[153355ab-6b79-4441-b958-8e83fc2e9432]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:38 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 Nov 02 14:34:38 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:38 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523" returned: 0 in 0.463s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 2G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:38 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 2G Nov 02 14:34:38 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:39 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:39 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:39 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:39 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 2G" returned: 0 in 0.694s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-842ef3ce-1399-4a15-9703-5e94224f3523 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.445s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:34:39 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-842ef3ce-1399-4a15-9703-5e94224f3523 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 Nov 02 14:34:39 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:39 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-842ef3ce-1399-4a15-9703-5e94224f3523 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694" returned: 0 in 0.336s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:39 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 is being set with open permissions: ugo+rw Nov 02 14:34:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:39 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 Nov 02 14:34:39 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:40 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694" returned: 0 in 0.324s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:40 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.info Nov 02 14:34:40 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:40 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.info" returned: 0 in 0.297s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:40 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.info is being set with open permissions: ugo+rw Nov 02 14:34:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:40 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.info Nov 02 14:34:40 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:40 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.info" returned: 0 in 0.262s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:40 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b04415d9-25ec-4117-8baa-7c62204c5a96 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Create snapshot completed successfully Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "cinder-d4084a4f-d452-4d79-a7ad-c477357ac694-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-d4084a4f-d452-4d79-a7ad-c477357ac694-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "cinder-quobyte-842ef3ce-1399-4a15-9703-5e94224f3523" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-quobyte-842ef3ce-1399-4a15-9703-5e94224f3523" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "cinder-quobyte-d4084a4f-d452-4d79-a7ad-c477357ac694" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-quobyte-d4084a4f-d452-4d79-a7ad-c477357ac694" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Deleting offline snapshot d4084a4f-d452-4d79-a7ad-c477357ac694 of volume 842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] snapshot_file for this snap is: volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8418a0e-b849-4996-b4f5-d0888ba7b4c4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:41 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 Nov 02 14:34:41 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:42 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694" returned: 0 in 0.405s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-842ef3ce-1399-4a15-9703-5e94224f3523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:34:42 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[887d7631-79ed-4a9e-978e-dfc9dd1317f2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:42 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 Nov 02 14:34:42 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:42 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523" returned: 0 in 0.455s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:42 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 Nov 02 14:34:42 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:43 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694" returned: 0 in 0.398s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:43 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694 Nov 02 14:34:43 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:43 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523.d4084a4f-d452-4d79-a7ad-c477357ac694" returned: 0 in 0.312s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-quobyte-d4084a4f-d452-4d79-a7ad-c477357ac694" released by "_delete_snapshot" :: held 1.733s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-quobyte-842ef3ce-1399-4a15-9703-5e94224f3523" released by "delete_snapshot" :: held 1.769s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Created reservations ['b6710832-b8fe-432e-ac19-81cd14a23674', '942044ec-639a-4334-b913-55e583c7d70f', 'eca74950-96e2-4fc5-8aad-5121449d1054', '13470310-83f4-4bf9-8549-2850e0c25daf'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Delete snapshot completed successfully. Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e903e51f-e305-4602-9350-5f06c98e5fa0 tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-d4084a4f-d452-4d79-a7ad-c477357ac694-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "cinder-842ef3ce-1399-4a15-9703-5e94224f3523-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-842ef3ce-1399-4a15-9703-5e94224f3523-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "cinder-quobyte-842ef3ce-1399-4a15-9703-5e94224f3523" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-quobyte-842ef3ce-1399-4a15-9703-5e94224f3523" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[477ce07b-bd15-446a-b880-be8663468417]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Flow 'volume_create_manager' (65900cb0-a7b0-4678-a99e-cebc54a92a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:44 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 Nov 02 14:34:44 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b4bf6-3c97-430e-b49a-44b829affe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b4bf6-3c97-430e-b49a-44b829affe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1637259494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a4d4e3-42e8-47dd-85e6-697bd0399f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e960e379dce4f5fb6b8de62d37d8638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:44Z,use_quota=True,user_id='22c6ee6eb03740a5a783e7a838195041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bce2556-0eef-4802-8de8-d0c3f2251940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bce2556-0eef-4802-8de8-d0c3f2251940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cca867a-6213-4d2f-9fa2-458a4c0184bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:34:44 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523" returned: 0 in 0.463s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:44 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523 Nov 02 14:34:44 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cca867a-6213-4d2f-9fa2-458a4c0184bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2a4d4e3-42e8-47dd-85e6-697bd0399f8d', 'volume_name': 'volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1790b45e-ece3-4fa1-8450-f13c6b5f7db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1790b45e-ece3-4fa1-8450-f13c6b5f7db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315a46d3-2f74-4187-8d00-e13aed77ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Volume d2a4d4e3-42e8-47dd-85e6-697bd0399f8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Trying to clone d2a4d4e3-42e8-47dd-85e6-697bd0399f8d from image 038a1496-6584-48e7-a7a3-32931ae28302 at location (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:34:44 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-842ef3ce-1399-4a15-9703-5e94224f3523" returned: 0 in 0.287s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-quobyte-842ef3ce-1399-4a15-9703-5e94224f3523" released by "delete_volume" :: held 0.852s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Created reservations ['db6d51d3-0df2-4b1f-bee6-e0ab063b22bb', 'c07c92c7-04eb-4da9-ae95-f71eb5cee5af', 'b8e57348-56a9-442c-956b-2c5407359f33', 'd4f813d8-b576-47cc-8032-66529f0d073d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:34:45 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Image download 20.69 MB at 20.69 MB/s Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd83e67-4068-48fb-aaef-a5bcdd6459b1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:45 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:45 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:45 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD Nov 02 14:34:45 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:45 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.293s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Deleted volume successfully. Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fea320-85c1-454b-9ded-05694ae3b2cf tempest-VolumesSnapshotNegativeTestJSON-1441908749 None] Lock "cinder-842ef3ce-1399-4a15-9703-5e94224f3523-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:45 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 is fetched for user 22c6ee6eb03740a5a783e7a838195041. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa12432-8146-4e7c-8665-bf3142cc4196]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:45 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD Nov 02 14:34:45 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:45 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1637259494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a4d4e3-42e8-47dd-85e6-697bd0399f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e960e379dce4f5fb6b8de62d37d8638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:44Z,use_quota=True,user_id='22c6ee6eb03740a5a783e7a838195041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Creating volume d2a4d4e3-42e8-47dd-85e6-697bd0399f8d {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:45 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:45 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d 1073741824 Nov 02 14:34:45 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:46 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d 1073741824" returned: 0 in 0.537s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:46 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d Nov 02 14:34:46 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:46 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d" returned: 0 in 0.275s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Attempting download of 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume d2a4d4e3-42e8-47dd-85e6-697bd0399f8d. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b552132-aa5d-4f90-a91f-0ffb0ec7494b]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_zo800s_c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:46 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_zo800s_c Nov 02 14:34:46 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:47 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_zo800s_c" returned: 0 in 0.404s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_zo800s_c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:47 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_zo800s_c Nov 02 14:34:47 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (4c3db114-1fe8-4c7c-a99e-27f12e6c95e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c700094-7be8-40cd-acde-3c36ee12ffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c700094-7be8-40cd-acde-3c36ee12ffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062441131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800da8f-1c34-4ee9-a032-7d2f8fa29e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:47Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0780f443-bb9f-4d5d-8cd3-fd448ef69c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0780f443-bb9f-4d5d-8cd3-fd448ef69c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41b745c-bce4-4b92-b406-3ba3ff705b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41b745c-bce4-4b92-b406-3ba3ff705b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6800da8f-1c34-4ee9-a032-7d2f8fa29e20', 'volume_name': 'volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68196c57-3129-49bb-a36f-d3a2d9c87138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68196c57-3129-49bb-a36f-d3a2d9c87138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1883d9e-a38e-4dce-a15f-f32f0dda42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:47 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume 6800da8f-1c34-4ee9-a032-7d2f8fa29e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20', 'volume_size': 1} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1062441131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800da8f-1c34-4ee9-a032-7d2f8fa29e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:47Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Creating volume 6800da8f-1c34-4ee9-a032-7d2f8fa29e20 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:47 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:47 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_zo800s_c" returned: 1 in 0.391s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_038a1496-6584-48e7-a7a3-32931ae28302_zo800s_c' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b112d-12ea-41c6-ba5f-79ad5bcd9dd9]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:47 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 1073741824 Nov 02 14:34:47 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:47 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD Nov 02 14:34:47 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:48 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] 038a1496-6584-48e7-a7a3-32931ae28302 was qcow2, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:48 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d Nov 02 14:34:48 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:48 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 1073741824" returned: 0 in 0.497s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:48 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 Nov 02 14:34:48 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:48 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20" returned: 0 in 0.320s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1883d9e-a38e-4dce-a15f-f32f0dda42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb829533-f2cb-4ad7-96c3-ef84b2122c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:48 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 (6800da8f-1c34-4ee9-a032-7d2f8fa29e20): created successfully Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb829533-f2cb-4ad7-96c3-ef84b2122c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (4c3db114-1fe8-4c7c-a99e-27f12e6c95e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1ef9e864-b3e9-4fac-a93b-fd423a7336a3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created volume successfully. Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (5dbba85a-1034-49c0-a353-06980a6589f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea3b407-ba14-454e-b436-a01cd0dd7dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea3b407-ba14-454e-b436-a01cd0dd7dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881687317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b997c015-e370-4c36-b9fc-6a47df22027e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:50Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf49eb-4a65-4b57-83eb-8bce0bb27945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1faf49eb-4a65-4b57-83eb-8bce0bb27945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee843c6e-84f4-4c9d-b0d6-b1447fe4410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee843c6e-84f4-4c9d-b0d6-b1447fe4410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b997c015-e370-4c36-b9fc-6a47df22027e', 'volume_name': 'volume-b997c015-e370-4c36-b9fc-6a47df22027e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61ecd57-df55-46db-8eda-5f916d864a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61ecd57-df55-46db-8eda-5f916d864a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753f6522-4d9e-43ac-8a2c-6d3c0697832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume b997c015-e370-4c36-b9fc-6a47df22027e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b997c015-e370-4c36-b9fc-6a47df22027e', 'volume_size': 1} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881687317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b997c015-e370-4c36-b9fc-6a47df22027e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:50Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Creating volume b997c015-e370-4c36-b9fc-6a47df22027e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:50 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d" returned: 0 in 2.228s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_038a1496-6584-48e7-a7a3-32931ae28302_s00fcg21devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:34:50 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Converted 112.00 MB image at 50.22 MB/s Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:50 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e 1073741824 Nov 02 14:34:50 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:50 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d 1G Nov 02 14:34:50 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (4f756541-dd5e-4e85-969c-5f6e76d2bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac36e4fb-612f-43b7-8c4e-78d3a172fa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac36e4fb-612f-43b7-8c4e-78d3a172fa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038664060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e97724-36f0-49f4-9e90-0938c68f277d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:51Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39448792-4094-4238-bbcf-bcda92423472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39448792-4094-4238-bbcf-bcda92423472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b3276d-fdc4-408f-80fd-d1d45be3c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b3276d-fdc4-408f-80fd-d1d45be3c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e97724-36f0-49f4-9e90-0938c68f277d', 'volume_name': 'volume-47e97724-36f0-49f4-9e90-0938c68f277d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16ef714-e5b2-4865-806f-8635c77c8b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16ef714-e5b2-4865-806f-8635c77c8b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd25e77b-0f6d-4ddd-ac3c-d40419a82aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:50 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume 47e97724-36f0-49f4-9e90-0938c68f277d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e97724-36f0-49f4-9e90-0938c68f277d', 'volume_size': 1} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d 1G" returned: 0 in 0.624s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Downloaded image 038a1496-6584-48e7-a7a3-32931ae28302 ((None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}])) to volume d2a4d4e3-42e8-47dd-85e6-697bd0399f8d successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Temporary image 038a1496-6584-48e7-a7a3-32931ae28302 for user 22c6ee6eb03740a5a783e7a838195041 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Marking volume d2a4d4e3-42e8-47dd-85e6-697bd0399f8d as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Copying metadata from image 038a1496-6584-48e7-a7a3-32931ae28302 to d2a4d4e3-42e8-47dd-85e6-697bd0399f8d. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Creating volume glance metadata for volume d2a4d4e3-42e8-47dd-85e6-697bd0399f8d backed by image 038a1496-6584-48e7-a7a3-32931ae28302 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:34:50 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e 1073741824" returned: 0 in 0.693s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:51 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e Nov 02 14:34:51 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315a46d3-2f74-4187-8d00-e13aed77ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d', 'volume_size': 1, 'image_id': '038a1496-6584-48e7-a7a3-32931ae28302', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/038a1496-6584-48e7-a7a3-32931ae28302', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65e6c79e4fdd44ee94dfdda7ea3e99a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '038a1496-6584-48e7-a7a3-32931ae28302', 'created_at': datetime.datetime(2026, 11, 2, 13, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/038a1496-6584-48e7-a7a3-32931ae28302/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b277058-fa4b-48ad-a49d-05eb60c415cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Volume volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d (d2a4d4e3-42e8-47dd-85e6-697bd0399f8d): created successfully Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b277058-fa4b-48ad-a49d-05eb60c415cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Flow 'volume_create_manager' (65900cb0-a7b0-4678-a99e-cebc54a92a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9dfc3d28-1126-4f06-88ff-92283cbb90fe tempest-TestShelveInstance-1301275793 None] Created volume successfully. Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (0a8416b9-367c-4c80-a71d-4c3e429762a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5893560e-8914-4eee-a618-6ac28a3e22d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5893560e-8914-4eee-a618-6ac28a3e22d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-174049774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d023d577-03dd-49cd-b0b4-97aaeab05a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:51Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c621a1e-2bca-484a-9755-4f9d5ab4caf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c621a1e-2bca-484a-9755-4f9d5ab4caf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07eae7e7-707b-474e-8b5f-917566e9c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07eae7e7-707b-474e-8b5f-917566e9c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd023d577-03dd-49cd-b0b4-97aaeab05a45', 'volume_name': 'volume-d023d577-03dd-49cd-b0b4-97aaeab05a45', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62250723-c551-4759-a8d7-b1382f3e9a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62250723-c551-4759-a8d7-b1382f3e9a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ced776-977e-4022-ac22-ca5b38969435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume d023d577-03dd-49cd-b0b4-97aaeab05a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d023d577-03dd-49cd-b0b4-97aaeab05a45', 'volume_size': 1} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:51 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e" returned: 0 in 0.407s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2038664060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e97724-36f0-49f4-9e90-0938c68f277d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:51Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Creating volume 47e97724-36f0-49f4-9e90-0938c68f277d {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:51 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753f6522-4d9e-43ac-8a2c-6d3c0697832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b997c015-e370-4c36-b9fc-6a47df22027e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e955ba-544e-44c1-819d-9d96c7e4ebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d 1073741824 Nov 02 14:34:51 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume volume-b997c015-e370-4c36-b9fc-6a47df22027e (b997c015-e370-4c36-b9fc-6a47df22027e): created successfully Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e955ba-544e-44c1-819d-9d96c7e4ebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (5dbba85a-1034-49c0-a353-06980a6589f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c5e046a8-6e87-4495-9b13-49cf34ebcd98 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created volume successfully. Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (b8a942d0-5ff1-4d4a-8090-2fdcd5139cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb73771-a7be-4248-82f2-7368cb18ed99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb73771-a7be-4248-82f2-7368cb18ed99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119034125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0490dcc0-8161-4632-acd7-8b4023635aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:51Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307b1653-35ad-4a25-b18a-0844eada64bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307b1653-35ad-4a25-b18a-0844eada64bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5fda96-47ad-4b38-87ce-111c11c2e7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5fda96-47ad-4b38-87ce-111c11c2e7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0490dcc0-8161-4632-acd7-8b4023635aaf', 'volume_name': 'volume-0490dcc0-8161-4632-acd7-8b4023635aaf', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0bf728-7b83-45a9-87dd-3f3210494a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0bf728-7b83-45a9-87dd-3f3210494a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee02ede3-39fe-42c3-9aff-bf417b8c8249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume 0490dcc0-8161-4632-acd7-8b4023635aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0490dcc0-8161-4632-acd7-8b4023635aaf', 'volume_size': 1} Nov 02 14:34:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:52 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d 1073741824" returned: 0 in 0.612s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (aca4759b-7ec1-4dc2-b865-6a0c8e08d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c117d9-87b8-475d-bb8f-5efc41f6e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c117d9-87b8-475d-bb8f-5efc41f6e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1263767993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c06aca-1353-43c2-b7ab-29021b5c8043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:52Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0008bd-3f6e-4ecd-9153-4bc0843d12e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0008bd-3f6e-4ecd-9153-4bc0843d12e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3409a40a-e811-4210-bc7b-d090051798e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3409a40a-e811-4210-bc7b-d090051798e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c06aca-1353-43c2-b7ab-29021b5c8043', 'volume_name': 'volume-70c06aca-1353-43c2-b7ab-29021b5c8043', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1632ba4a-4e13-43ce-9af2-1ec274a1263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1632ba4a-4e13-43ce-9af2-1ec274a1263c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2201e8b6-d0f6-4587-ae64-93816b465a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:52 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume 70c06aca-1353-43c2-b7ab-29021b5c8043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c06aca-1353-43c2-b7ab-29021b5c8043', 'volume_size': 1} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:52 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d Nov 02 14:34:52 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:52 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d" returned: 0 in 0.310s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-174049774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d023d577-03dd-49cd-b0b4-97aaeab05a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:51Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Creating volume d023d577-03dd-49cd-b0b4-97aaeab05a45 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:52 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd25e77b-0f6d-4ddd-ac3c-d40419a82aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e97724-36f0-49f4-9e90-0938c68f277d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:52 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 1073741824 Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082402f1-6b5e-461b-8ea9-7b6e3dd99dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:52 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:52 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume volume-47e97724-36f0-49f4-9e90-0938c68f277d (47e97724-36f0-49f4-9e90-0938c68f277d): created successfully Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082402f1-6b5e-461b-8ea9-7b6e3dd99dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (4f756541-dd5e-4e85-969c-5f6e76d2bb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-70e76f57-f4e6-47fb-8566-15d5bb15f3d3 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created volume successfully. Nov 02 14:34:53 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 1073741824" returned: 0 in 0.562s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:53 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 Nov 02 14:34:53 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:53 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45" returned: 0 in 0.287s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119034125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0490dcc0-8161-4632-acd7-8b4023635aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:51Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Creating volume 0490dcc0-8161-4632-acd7-8b4023635aaf {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:53 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:53 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf 1073741824 Nov 02 14:34:53 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ced776-977e-4022-ac22-ca5b38969435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d023d577-03dd-49cd-b0b4-97aaeab05a45', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15568dd6-78c7-413f-83b5-b1c3da998a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:53 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 (d023d577-03dd-49cd-b0b4-97aaeab05a45): created successfully Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15568dd6-78c7-413f-83b5-b1c3da998a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (0a8416b9-367c-4c80-a71d-4c3e429762a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a1fd0b56-2aee-4189-977b-a6a63d09a45c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created volume successfully. Nov 02 14:34:53 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf 1073741824" returned: 0 in 0.527s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:54 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf Nov 02 14:34:54 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:54 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf" returned: 0 in 0.303s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1263767993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c06aca-1353-43c2-b7ab-29021b5c8043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='569467989c0c4ad09667b0e85bf2fe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:34:52Z,use_quota=True,user_id='b0343e9681214d5d9dccae6b46c4cffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Creating volume 70c06aca-1353-43c2-b7ab-29021b5c8043 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:34:54 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:54 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 1073741824 Nov 02 14:34:54 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee02ede3-39fe-42c3-9aff-bf417b8c8249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0490dcc0-8161-4632-acd7-8b4023635aaf', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31c0463-aa77-4d95-b6df-3b56b94f9bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:54 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume volume-0490dcc0-8161-4632-acd7-8b4023635aaf (0490dcc0-8161-4632-acd7-8b4023635aaf): created successfully Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31c0463-aa77-4d95-b6df-3b56b94f9bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (b8a942d0-5ff1-4d4a-8090-2fdcd5139cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3743d1e4-da98-4710-a691-899479efe071 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created volume successfully. Nov 02 14:34:54 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 1073741824" returned: 0 in 0.574s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:55 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 Nov 02 14:34:55 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:55 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043" returned: 0 in 0.424s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2201e8b6-d0f6-4587-ae64-93816b465a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c06aca-1353-43c2-b7ab-29021b5c8043', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0782dbc-0cdd-4fdc-af84-ece46a09606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:34:55 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Volume volume-70c06aca-1353-43c2-b7ab-29021b5c8043 (70c06aca-1353-43c2-b7ab-29021b5c8043): created successfully Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0782dbc-0cdd-4fdc-af84-ece46a09606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Flow 'volume_create_manager' (aca4759b-7ec1-4dc2-b865-6a0c8e08d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:34:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0298ab0b-9cec-49ad-861b-c5d183d130d4 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created volume successfully. Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-285174a5-a3c3-41c7-af41-aef7901dcd11 req-b109256f-8c72-4fe3-8a80-2f85fb5b22f6 tempest-TestShelveInstance-1301275793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-285174a5-a3c3-41c7-af41-aef7901dcd11 req-b109256f-8c72-4fe3-8a80-2f85fb5b22f6 tempest-TestShelveInstance-1301275793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-285174a5-a3c3-41c7-af41-aef7901dcd11 req-b109256f-8c72-4fe3-8a80-2f85fb5b22f6 tempest-TestShelveInstance-1301275793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-70c06aca-1353-43c2-b7ab-29021b5c8043-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-70c06aca-1353-43c2-b7ab-29021b5c8043-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-285174a5-a3c3-41c7-af41-aef7901dcd11 req-b109256f-8c72-4fe3-8a80-2f85fb5b22f6 tempest-TestShelveInstance-1301275793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c67d7df-7a93-4c7e-a505-4dfe61c1734d', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=139,cinder:INSERT=40,cinder:UPDATE=136,cinder:DELETE=13 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=121,cinder:INSERT=41,cinder:UPDATE=142,cinder:DELETE=10 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-quobyte-70c06aca-1353-43c2-b7ab-29021b5c8043" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-70c06aca-1353-43c2-b7ab-29021b5c8043" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c8043-b2ee-4747-b37e-655efff0bea3]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-285174a5-a3c3-41c7-af41-aef7901dcd11 req-b109256f-8c72-4fe3-8a80-2f85fb5b22f6 tempest-TestShelveInstance-1301275793 None] attachment_update completed successfully. Nov 02 14:34:55 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 Nov 02 14:34:55 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:56 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043" returned: 0 in 0.475s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:56 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043 Nov 02 14:34:56 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:56 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-70c06aca-1353-43c2-b7ab-29021b5c8043" returned: 0 in 0.363s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-70c06aca-1353-43c2-b7ab-29021b5c8043" released by "delete_volume" :: held 0.909s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created reservations ['de6ed282-5e50-4843-b967-dd5996d80735', '0051bcc7-edc4-4aa1-af4a-6cd8f0c01ae8', 'eecf0447-9157-4812-91b5-984127dc7e90', 'd58f7e9c-7179-477f-88c4-697735c13db4'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:56 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:57 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:57 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.341s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:57 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Deleted volume successfully. Nov 02 14:34:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c8137c46-7f5d-440f-a1a1-46bb3fea9285 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-70c06aca-1353-43c2-b7ab-29021b5c8043-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-0490dcc0-8161-4632-acd7-8b4023635aaf-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-0490dcc0-8161-4632-acd7-8b4023635aaf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-quobyte-0490dcc0-8161-4632-acd7-8b4023635aaf" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-0490dcc0-8161-4632-acd7-8b4023635aaf" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[27005f0e-19de-46cc-bf10-86ef9f566768]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:58 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf Nov 02 14:34:58 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:58 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:58 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf Nov 02 14:34:58 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:58 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-0490dcc0-8161-4632-acd7-8b4023635aaf" returned: 0 in 0.315s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-0490dcc0-8161-4632-acd7-8b4023635aaf" released by "delete_volume" :: held 0.823s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:58 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created reservations ['f65db967-7b0f-43a5-a244-91442c9d2835', '715e81ed-2d9b-4d2e-a416-b6e5fe1c155c', '3822847e-a167-476a-808a-fc6803fabc8a', '66e74532-4b20-4f97-91ec-e482bc5940db'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:59 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:34:59 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-d023d577-03dd-49cd-b0b4-97aaeab05a45-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-d023d577-03dd-49cd-b0b4-97aaeab05a45-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-quobyte-d023d577-03dd-49cd-b0b4-97aaeab05a45" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-d023d577-03dd-49cd-b0b4-97aaeab05a45" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b8e51-69b1-49e4-bc83-272039f49d2e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:59 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.493s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:34:59 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Deleted volume successfully. Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e279b28b-80af-4cc8-bc38-d7bfaef77e22 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-0490dcc0-8161-4632-acd7-8b4023635aaf-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:34:59 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 Nov 02 14:34:59 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:34:59 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45" returned: 0 in 0.462s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:34:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:34:59 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45 Nov 02 14:34:59 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:00 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d023d577-03dd-49cd-b0b4-97aaeab05a45" returned: 0 in 0.286s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-d023d577-03dd-49cd-b0b4-97aaeab05a45" released by "delete_volume" :: held 0.862s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created reservations ['f6e62497-9431-4902-9f27-5e38241b01a6', '081c49f3-b177-4c4f-8819-4eb523c0a1b7', 'ef3f4578-c5a6-4ac7-b390-8bd686416e88', '27854fd2-69df-4ced-9613-919e89e31e49'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:00 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:00 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:00 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.286s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Deleted volume successfully. Nov 02 14:35:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-47db0d70-2532-49a8-be14-5be3a0e85cef tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-d023d577-03dd-49cd-b0b4-97aaeab05a45-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-47e97724-36f0-49f4-9e90-0938c68f277d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-47e97724-36f0-49f4-9e90-0938c68f277d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-quobyte-47e97724-36f0-49f4-9e90-0938c68f277d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-47e97724-36f0-49f4-9e90-0938c68f277d" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:01 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b66bec5-1fe5-445e-ad55-2bae6fb06c9a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:01 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d Nov 02 14:35:01 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:02 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d" returned: 0 in 0.481s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:02 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d Nov 02 14:35:02 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:02 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-47e97724-36f0-49f4-9e90-0938c68f277d" returned: 0 in 0.338s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-47e97724-36f0-49f4-9e90-0938c68f277d" released by "delete_volume" :: held 0.875s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created reservations ['89c6873a-a866-4fbc-8a8c-3e94e4af52c1', 'ef702fd0-d7a4-4b92-a5da-63d6b11e273b', '393381f2-97e9-4f94-b1e1-51e6dfdd3def', 'e94edf28-c962-4e0b-9486-5717a5f8cc65'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:02 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:02 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-b997c015-e370-4c36-b9fc-6a47df22027e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-b997c015-e370-4c36-b9fc-6a47df22027e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-quobyte-b997c015-e370-4c36-b9fc-6a47df22027e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-b997c015-e370-4c36-b9fc-6a47df22027e" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac82809-1e42-4083-bdf9-89bb4726c6fa]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:03 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e Nov 02 14:35:03 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:03 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:03 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Deleted volume successfully. Nov 02 14:35:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f2974df-6247-4ea7-babe-f5656bf20a0c tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-47e97724-36f0-49f4-9e90-0938c68f277d-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:03 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e" returned: 0 in 0.779s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:03 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e Nov 02 14:35:03 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:04 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b997c015-e370-4c36-b9fc-6a47df22027e" returned: 0 in 0.555s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-b997c015-e370-4c36-b9fc-6a47df22027e" released by "delete_volume" :: held 1.407s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created reservations ['b280cd53-0e3e-4f99-848f-c632ab008c54', '73cb9558-c7f1-453a-9e23-9454139c7863', '0fe3d551-088f-4e71-a86f-83aa5934ab09', '7547c0ca-5d18-469b-9f49-fe1e15e2a2f9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:04 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:04 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:04 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.369s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Deleted volume successfully. Nov 02 14:35:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bc63aade-aa61-4734-a800-3119a6655b39 tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-b997c015-e370-4c36-b9fc-6a47df22027e-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-6800da8f-1c34-4ee9-a032-7d2f8fa29e20-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-6800da8f-1c34-4ee9-a032-7d2f8fa29e20-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "cinder-quobyte-6800da8f-1c34-4ee9-a032-7d2f8fa29e20" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-6800da8f-1c34-4ee9-a032-7d2f8fa29e20" acquired by "delete_volume" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1355208-37ce-4a4d-a2e9-9f1abfe5f815]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:05 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 Nov 02 14:35:05 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:05 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20" returned: 0 in 0.542s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:05 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20 Nov 02 14:35:05 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:06 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6800da8f-1c34-4ee9-a032-7d2f8fa29e20" returned: 0 in 0.308s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-quobyte-6800da8f-1c34-4ee9-a032-7d2f8fa29e20" released by "delete_volume" :: held 0.911s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Created reservations ['a9f9bcf6-f0bd-49d8-9b93-ded97f1c3cb0', '26ded987-b2e1-4fdd-b2d5-6c8363273872', 'ba6db2ba-8d8e-4213-9f0a-ab5950a84c6d', '6c34316a-7ebd-477a-b4e6-6ff897e564b8'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:06 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:06 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:06 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Deleted volume successfully. Nov 02 14:35:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-478f52e2-27f5-48c9-80b8-a52e1e0bd5da tempest-CreateVolumesFromSourceVolumeTest-1932958984 None] Lock "cinder-6800da8f-1c34-4ee9-a032-7d2f8fa29e20-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:16 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=27,cinder:INSERT=13,cinder:UPDATE=46,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:35:16 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=51,cinder:SELECT=36,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (9b753913-867a-4cf1-8da0-ec4401c2e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e9ccd3-851d-45c2-8c32-c34cfc884273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e9ccd3-851d-45c2-8c32-c34cfc884273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1570822837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:18Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d2c506-f231-409e-bba0-5ef73c6ee321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d2c506-f231-409e-bba0-5ef73c6ee321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b62fc3-0835-443c-9887-51918132011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00b62fc3-0835-443c-9887-51918132011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f', 'volume_name': 'volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e07f27-cf64-4bd3-9159-936f8be85dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e07f27-cf64-4bd3-9159-936f8be85dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff77251-d344-43c3-afe5-d2fc403b47e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Volume 4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f', 'volume_size': 1} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1570822837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:18Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Creating volume 4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:35:18 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:18 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f 1073741824 Nov 02 14:35:18 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:18 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f 1073741824" returned: 0 in 0.495s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:18 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f Nov 02 14:35:18 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:19 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f" returned: 0 in 0.318s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:35:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff77251-d344-43c3-afe5-d2fc403b47e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e1d44-56a4-4b6e-8a91-711e9e99ce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Volume volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f (4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f): created successfully Nov 02 14:35:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204e1d44-56a4-4b6e-8a91-711e9e99ce7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (9b753913-867a-4cf1-8da0-ec4401c2e900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a1a41a15-3f5b-49e8-9f4c-79ee836691cd tempest-ProjectReaderTests-975111636 None] Created volume successfully. Nov 02 14:35:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Lock "cinder-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-quobyte-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea8d44d-789d-4150-9991-ec33aa00a59f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:20 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f Nov 02 14:35:20 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:21 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f" returned: 0 in 0.506s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:21 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f Nov 02 14:35:21 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:21 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f" returned: 0 in 0.325s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f" released by "delete_volume" :: held 0.913s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Created reservations ['8f8f59b9-e1a5-44e4-803e-c794395f8acc', '347ea866-fe2e-4987-bb7e-8b2f84b2ebf1', '62aaa7ab-e487-48fa-a4b5-a286f2aeb26c', 'b83ca118-8576-43f1-8525-66107c00811e'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:21 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:21 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:22 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.405s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:22 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Deleted volume successfully. Nov 02 14:35:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-55ae7191-8112-4b37-a952-fc97a10701e9 tempest-ProjectReaderTests-975111636 None] Lock "cinder-4f48d30c-ef4a-4187-bf9d-4d793bd1cf0f-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (6c740289-3650-41a3-ad1a-064552fe679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9140d30-f858-4a43-a215-99f982c80058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9140d30-f858-4a43-a215-99f982c80058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113431450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed5541f-cef0-40f7-8dcd-cc4733ee82a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:23Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bb98ec-f9f6-4ac9-957c-665afa1c9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72bb98ec-f9f6-4ac9-957c-665afa1c9eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b007b361-c6cb-44dd-8c29-611f3a7e67e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b007b361-c6cb-44dd-8c29-611f3a7e67e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed5541f-cef0-40f7-8dcd-cc4733ee82a9', 'volume_name': 'volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b7691c-70fd-48a4-ab65-3875e9c83180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b7691c-70fd-48a4-ab65-3875e9c83180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e09f5d-9da1-43a9-ace6-cd03cdcef4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Volume eed5541f-cef0-40f7-8dcd-cc4733ee82a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9', 'volume_size': 1} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-113431450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed5541f-cef0-40f7-8dcd-cc4733ee82a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:23Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Creating volume eed5541f-cef0-40f7-8dcd-cc4733ee82a9 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:35:23 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:23 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 1073741824 Nov 02 14:35:23 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:23 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 1073741824" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:24 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 Nov 02 14:35:24 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:24 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9" returned: 0 in 0.489s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:35:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e09f5d-9da1-43a9-ace6-cd03cdcef4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b23b851-c977-415e-b16b-e1bf79c747eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:24 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Volume volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 (eed5541f-cef0-40f7-8dcd-cc4733ee82a9): created successfully Nov 02 14:35:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b23b851-c977-415e-b16b-e1bf79c747eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:24 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (6c740289-3650-41a3-ad1a-064552fe679f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:24 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ddd00ff2-8e91-4aeb-a9d9-4f6f68db9fde tempest-ProjectReaderTests-975111636 None] Created volume successfully. Nov 02 14:35:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-eed5541f-cef0-40f7-8dcd-cc4733ee82a9-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Lock "cinder-eed5541f-cef0-40f7-8dcd-cc4733ee82a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-quobyte-eed5541f-cef0-40f7-8dcd-cc4733ee82a9" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-eed5541f-cef0-40f7-8dcd-cc4733ee82a9" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0525e15b-7e5d-47d3-be8d-508f2781c2d4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:25 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 Nov 02 14:35:25 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:26 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9" returned: 0 in 0.443s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:26 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9 Nov 02 14:35:26 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:26 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-eed5541f-cef0-40f7-8dcd-cc4733ee82a9" returned: 0 in 0.285s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-eed5541f-cef0-40f7-8dcd-cc4733ee82a9" released by "delete_volume" :: held 0.797s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Created reservations ['539e4426-dd7c-409b-904e-e6b63910b573', 'e1496b91-4297-452b-84b0-4b1f1497a311', 'fffa6a35-7c5c-4abd-bed0-60b2e710d0d4', '76e3da93-538f-46da-84f1-3fb3c6ca3ac7'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:26 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:26 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:26 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.318s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Deleted volume successfully. Nov 02 14:35:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b1a1b13b-191e-4a85-b0e2-d675baa87892 tempest-ProjectReaderTests-975111636 None] Lock "cinder-eed5541f-cef0-40f7-8dcd-cc4733ee82a9-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (34018a2b-865f-482b-be42-bfd21d87aaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b9725e-a345-4fe3-a7d6-033661d49a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b9725e-a345-4fe3-a7d6-033661d49a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573227564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844e5004-b6a9-4b58-84fe-3cd984777e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:27Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3581a3-5c17-46d6-8cba-fbbce950ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3581a3-5c17-46d6-8cba-fbbce950ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f8d866-c438-4069-9211-d8685023733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f8d866-c438-4069-9211-d8685023733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844e5004-b6a9-4b58-84fe-3cd984777e9f', 'volume_name': 'volume-844e5004-b6a9-4b58-84fe-3cd984777e9f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d200b387-1377-4a9e-b241-d85dcfa9a103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d200b387-1377-4a9e-b241-d85dcfa9a103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52405ebf-7546-42fb-8bb2-92abef80eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Volume 844e5004-b6a9-4b58-84fe-3cd984777e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844e5004-b6a9-4b58-84fe-3cd984777e9f', 'volume_size': 1} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573227564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844e5004-b6a9-4b58-84fe-3cd984777e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:27Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Creating volume 844e5004-b6a9-4b58-84fe-3cd984777e9f {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:35:27 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:35:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:27 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f 1073741824 Nov 02 14:35:27 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:28 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f 1073741824" returned: 0 in 0.684s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:28 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f Nov 02 14:35:28 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:28 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f" returned: 0 in 0.275s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52405ebf-7546-42fb-8bb2-92abef80eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844e5004-b6a9-4b58-84fe-3cd984777e9f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf9f36d-3851-410c-bfe6-2ad85fa43be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:28 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Volume volume-844e5004-b6a9-4b58-84fe-3cd984777e9f (844e5004-b6a9-4b58-84fe-3cd984777e9f): created successfully Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf9f36d-3851-410c-bfe6-2ad85fa43be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (34018a2b-865f-482b-be42-bfd21d87aaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f0c4366e-e280-4f0c-9585-5ffbec3a0c84 tempest-ProjectReaderTests-975111636 None] Created volume successfully. Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-844e5004-b6a9-4b58-84fe-3cd984777e9f-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Lock "cinder-844e5004-b6a9-4b58-84fe-3cd984777e9f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-quobyte-844e5004-b6a9-4b58-84fe-3cd984777e9f" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-844e5004-b6a9-4b58-84fe-3cd984777e9f" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835881e-d8b8-4cdd-9245-7f27488fa9de]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:29 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f Nov 02 14:35:29 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:29 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f" returned: 0 in 0.400s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:29 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f Nov 02 14:35:29 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:30 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-844e5004-b6a9-4b58-84fe-3cd984777e9f" returned: 0 in 0.302s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-844e5004-b6a9-4b58-84fe-3cd984777e9f" released by "delete_volume" :: held 0.759s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Created reservations ['8aac8cd6-a829-433a-a798-bfd1bd69048e', 'b99eec13-23b5-4a78-93f2-e9963e2a2e67', '4b8a9f49-5ac6-443f-8dca-755d5e55d681', '495085ff-dcda-444c-8435-473f7776ff5c'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:30 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:30 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:30 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.316s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:30 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Deleted volume successfully. Nov 02 14:35:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e6dfbcf-27b5-43ed-8186-0e36de72cdcd tempest-ProjectReaderTests-975111636 None] Lock "cinder-844e5004-b6a9-4b58-84fe-3cd984777e9f-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (d02e06f7-2fa5-4216-8b8f-5652016d23f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ea877b-3234-4149-8f67-bdb609bb2661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ea877b-3234-4149-8f67-bdb609bb2661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541953167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63de5ee3-2edf-41c0-b1b4-a20b47746457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:31Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951b8902-b237-4de8-8bf8-0471b28013c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951b8902-b237-4de8-8bf8-0471b28013c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65b6d40-0d62-4d6a-9c45-ab1899af024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65b6d40-0d62-4d6a-9c45-ab1899af024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63de5ee3-2edf-41c0-b1b4-a20b47746457', 'volume_name': 'volume-63de5ee3-2edf-41c0-b1b4-a20b47746457', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3be743-72f1-425b-bec9-054ed5fbb892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3be743-72f1-425b-bec9-054ed5fbb892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ce5ec4-f2cd-48b4-b556-21f5beb7e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:31 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Volume 63de5ee3-2edf-41c0-b1b4-a20b47746457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63de5ee3-2edf-41c0-b1b4-a20b47746457', 'volume_size': 1} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541953167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63de5ee3-2edf-41c0-b1b4-a20b47746457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea1d51a44b24130bd6a1fe6fb2230c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:31Z,use_quota=True,user_id='10ba1ebecbc746bb840e151049aabacf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Creating volume 63de5ee3-2edf-41c0-b1b4-a20b47746457 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:35:31 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:31 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 1073741824 Nov 02 14:35:31 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:31 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 1073741824" returned: 0 in 0.466s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:31 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 Nov 02 14:35:31 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:32 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:35:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ce5ec4-f2cd-48b4-b556-21f5beb7e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63de5ee3-2edf-41c0-b1b4-a20b47746457', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410edd40-f188-48a8-bfcd-bbcb9e121b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:32 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Volume volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 (63de5ee3-2edf-41c0-b1b4-a20b47746457): created successfully Nov 02 14:35:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410edd40-f188-48a8-bfcd-bbcb9e121b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Flow 'volume_create_manager' (d02e06f7-2fa5-4216-8b8f-5652016d23f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-48030aed-7b4e-4d53-96aa-ddc473c42cfa tempest-ProjectReaderTests-975111636 None] Created volume successfully. Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-63de5ee3-2edf-41c0-b1b4-a20b47746457-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Lock "cinder-63de5ee3-2edf-41c0-b1b4-a20b47746457-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Acquiring lock "cinder-quobyte-63de5ee3-2edf-41c0-b1b4-a20b47746457" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-63de5ee3-2edf-41c0-b1b4-a20b47746457" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c85ea2-64eb-42ef-af51-c84ec556a706]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:33 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 Nov 02 14:35:33 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:33 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:33 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457 Nov 02 14:35:33 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:34 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-63de5ee3-2edf-41c0-b1b4-a20b47746457" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Lock "cinder-quobyte-63de5ee3-2edf-41c0-b1b4-a20b47746457" released by "delete_volume" :: held 0.681s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Created reservations ['ec6bff31-5fe9-4143-8270-b89a3594e865', '4a756104-5dbf-4442-89dc-da4da4082db2', 'ab3c0d7b-dfbe-4b57-8714-0bf81b50eaab', '5efc01b2-077e-4e06-aafc-de787a2351a6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:34 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:34 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:34 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.310s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Deleted volume successfully. Nov 02 14:35:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6ec6b848-bde4-4cf8-9cfe-473797f646d7 tempest-ProjectReaderTests-975111636 None] Lock "cinder-63de5ee3-2edf-41c0-b1b4-a20b47746457-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-43f43de5-f75a-489c-938b-58a89ba29c97 req-2c38a321-5e97-40cb-97cd-535bd3d4fb07 tempest-TestShelveInstance-1301275793 None] Terminate volume connection completed successfully. Nov 02 14:35:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-43f43de5-f75a-489c-938b-58a89ba29c97 req-2c38a321-5e97-40cb-97cd-535bd3d4fb07 tempest-TestShelveInstance-1301275793 None] Deleting attachment 9c67d7df-7a93-4c7e-a505-4dfe61c1734d. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:39 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:39 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:39 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.378s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:35:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:35:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c813b6ca-4328-4ab4-ba2a-83be7cc6aeb1 req-ecbdd5f5-a528-479f-bbf2-ba958b8cc1c4 tempest-TestShelveInstance-1301275793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c813b6ca-4328-4ab4-ba2a-83be7cc6aeb1 req-ecbdd5f5-a528-479f-bbf2-ba958b8cc1c4 tempest-TestShelveInstance-1301275793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c813b6ca-4328-4ab4-ba2a-83be7cc6aeb1 req-ecbdd5f5-a528-479f-bbf2-ba958b8cc1c4 tempest-TestShelveInstance-1301275793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-c813b6ca-4328-4ab4-ba2a-83be7cc6aeb1 req-ecbdd5f5-a528-479f-bbf2-ba958b8cc1c4 tempest-TestShelveInstance-1301275793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ac8a935-9b96-42cd-b265-f8b045b5166b', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:35:40 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-c813b6ca-4328-4ab4-ba2a-83be7cc6aeb1 req-ecbdd5f5-a528-479f-bbf2-ba958b8cc1c4 tempest-TestShelveInstance-1301275793 None] attachment_update completed successfully. Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Flow 'volume_create_manager' (7f36394c-efc1-4232-b17d-d0e53f72d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ceb8c7-fc96-43b7-a5de-5693a669b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ceb8c7-fc96-43b7-a5de-5693a669b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1395007395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46035329-7fcb-4f23-8736-ebe297d8da3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd19ea4f52fe4e02a2a9cdfdad30ee95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:49Z,use_quota=True,user_id='4b93dab830a0454eb36d2c58dfc3c17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4de30d-0d0d-4226-a892-dd6141376584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4de30d-0d0d-4226-a892-dd6141376584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873c54f9-ed6a-4955-a5ab-bef5ed551076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873c54f9-ed6a-4955-a5ab-bef5ed551076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46035329-7fcb-4f23-8736-ebe297d8da3a', 'volume_name': 'volume-46035329-7fcb-4f23-8736-ebe297d8da3a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6eaf6-1999-4321-beab-ca5333407c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6eaf6-1999-4321-beab-ca5333407c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d76544-5191-47e1-a364-468518c16b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:48 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Volume 46035329-7fcb-4f23-8736-ebe297d8da3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46035329-7fcb-4f23-8736-ebe297d8da3a', 'volume_size': 1} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1395007395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46035329-7fcb-4f23-8736-ebe297d8da3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd19ea4f52fe4e02a2a9cdfdad30ee95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:35:49Z,use_quota=True,user_id='4b93dab830a0454eb36d2c58dfc3c17a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Creating volume 46035329-7fcb-4f23-8736-ebe297d8da3a {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:35:48 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:35:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:48 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a 1073741824 Nov 02 14:35:48 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:49 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a 1073741824" returned: 0 in 0.593s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:49 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a Nov 02 14:35:49 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:49 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a" returned: 0 in 0.401s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d76544-5191-47e1-a364-468518c16b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46035329-7fcb-4f23-8736-ebe297d8da3a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb8b768-931b-4356-a254-a68f30d586be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:35:49 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Volume volume-46035329-7fcb-4f23-8736-ebe297d8da3a (46035329-7fcb-4f23-8736-ebe297d8da3a): created successfully Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb8b768-931b-4356-a254-a68f30d586be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:35:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Flow 'volume_create_manager' (7f36394c-efc1-4232-b17d-d0e53f72d724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:35:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-359b0711-3afb-4590-8567-8fc5c14ed400 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Created volume successfully. Nov 02 14:35:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-be338c08-c89b-4a40-a915-9cabadba2b76 req-a6d81df5-5fe7-4b23-9347-fa73ee96373c tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-be338c08-c89b-4a40-a915-9cabadba2b76 req-a6d81df5-5fe7-4b23-9347-fa73ee96373c tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-be338c08-c89b-4a40-a915-9cabadba2b76 req-a6d81df5-5fe7-4b23-9347-fa73ee96373c tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-be338c08-c89b-4a40-a915-9cabadba2b76 req-a6d81df5-5fe7-4b23-9347-fa73ee96373c tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-46035329-7fcb-4f23-8736-ebe297d8da3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae32c837-6cbf-4280-a70c-83d930e0a694', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:35:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-be338c08-c89b-4a40-a915-9cabadba2b76 req-a6d81df5-5fe7-4b23-9347-fa73ee96373c tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] attachment_update completed successfully. Nov 02 14:35:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-f35e6f2b-ccd2-483e-ab16-c4dad1b7c58f req-ef346b1c-fe8b-46f3-8ca9-d98bfc9ac982 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Terminate volume connection completed successfully. Nov 02 14:35:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-f35e6f2b-ccd2-483e-ab16-c4dad1b7c58f req-ef346b1c-fe8b-46f3-8ca9-d98bfc9ac982 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Deleting attachment ae32c837-6cbf-4280-a70c-83d930e0a694. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:35:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Acquiring lock "cinder-46035329-7fcb-4f23-8736-ebe297d8da3a-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "cinder-46035329-7fcb-4f23-8736-ebe297d8da3a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Acquiring lock "cinder-quobyte-46035329-7fcb-4f23-8736-ebe297d8da3a" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:35:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "cinder-quobyte-46035329-7fcb-4f23-8736-ebe297d8da3a" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:35:56 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c8de96-3c73-4446-9a41-0d7c8297a05f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:35:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:56 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a Nov 02 14:35:56 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:57 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a" returned: 0 in 0.437s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:57 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a Nov 02 14:35:57 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:57 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-46035329-7fcb-4f23-8736-ebe297d8da3a" returned: 0 in 0.303s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "cinder-quobyte-46035329-7fcb-4f23-8736-ebe297d8da3a" released by "delete_volume" :: held 0.816s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Created reservations ['9258f131-4d07-4330-a3c4-703fc1b5423c', '569166d0-5b3d-4156-9370-4aca44d91179', 'd52503d1-cf69-4bd2-a1f9-bad67726912c', '741ad589-9dc2-4899-8f43-6720e8e371cc'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:35:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:35:57 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:35:57 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:35:58 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 02 14:35:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.427s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:35:58 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:35:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Deleted volume successfully. Nov 02 14:35:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-15993357-545f-4749-9256-9591848f4f71 tempest-TestServerVolumeAttachScenarioOldVersion-1740770917 None] Lock "cinder-46035329-7fcb-4f23-8736-ebe297d8da3a-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Flow 'volume_create_manager' (e53b9951-edb6-4f0d-a42f-52bf37bc057c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf51a961-3c7a-4405-8072-464336b8c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf51a961-3c7a-4405-8072-464336b8c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1830190654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a9dba6-9582-478d-b0a5-6b0c48378c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108f8e2057c14d2b8a91867d65f5bd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:04Z,use_quota=True,user_id='40142a8a3ecf45679ac5315994212bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7becd9-a0fd-46de-bf5a-f43c0ae010d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7becd9-a0fd-46de-bf5a-f43c0ae010d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d3f641-f81e-42bb-8e12-60b608111a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d3f641-f81e-42bb-8e12-60b608111a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a9dba6-9582-478d-b0a5-6b0c48378c50', 'volume_name': 'volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f248e503-2c20-45be-8e6f-b0e6bcc3a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f248e503-2c20-45be-8e6f-b0e6bcc3a003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d1d619-9932-4936-ae4a-7fa0d2a6e2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:04 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Volume c4a9dba6-9582-478d-b0a5-6b0c48378c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50', 'volume_size': 1} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1830190654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a9dba6-9582-478d-b0a5-6b0c48378c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108f8e2057c14d2b8a91867d65f5bd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:04Z,use_quota=True,user_id='40142a8a3ecf45679ac5315994212bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Creating volume c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:04 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:04 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 1073741824 Nov 02 14:36:04 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:04 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 1073741824" returned: 0 in 0.456s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:04 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 Nov 02 14:36:04 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:04 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50" returned: 0 in 0.256s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d1d619-9932-4936-ae4a-7fa0d2a6e2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a673f2ab-a97d-48a9-b2bc-90dd7e9be243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:04 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Volume volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 (c4a9dba6-9582-478d-b0a5-6b0c48378c50): created successfully Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a673f2ab-a97d-48a9-b2bc-90dd7e9be243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Flow 'volume_create_manager' (e53b9951-edb6-4f0d-a42f-52bf37bc057c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-64b67d50-da1e-4c9c-83dc-2dd30563d776 tempest-SnapshotDependencyTests-1643689507 None] Created volume successfully. Nov 02 14:36:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Creating offline snapshot 3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b of volume c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:36:06 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[912bdbe9-5d77-4407-a060-a5257f0a1c67]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:06 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 Nov 02 14:36:06 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:06 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:06 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b 1G Nov 02 14:36:06 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:07 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b 1G" returned: 0 in 0.459s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:07 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b Nov 02 14:36:07 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:07 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" returned: 0 in 0.327s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:07 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b is being set with open permissions: ugo+rw Nov 02 14:36:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:07 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b Nov 02 14:36:07 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:07 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:07 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.info Nov 02 14:36:07 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:08 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.info" returned: 0 in 0.253s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:08 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.info is being set with open permissions: ugo+rw Nov 02 14:36:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:08 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.info Nov 02 14:36:08 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:08 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.info" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-aa1723b8-e603-4c92-a98d-85028adb4e11 tempest-SnapshotDependencyTests-1643689507 None] Create snapshot completed successfully Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Flow 'volume_create_manager' (cd3ab45d-fcdd-44de-b2c8-df5d31c8dd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a84fc3-5f83-44e7-b573-8919b9caa1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a84fc3-5f83-44e7-b573-8919b9caa1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91b5c33-8762-4f53-9684-d248ebcbfb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='108f8e2057c14d2b8a91867d65f5bd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:10Z,use_quota=True,user_id='40142a8a3ecf45679ac5315994212bc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d0c6f9-1a26-46f4-a102-7f83307e234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d0c6f9-1a26-46f4-a102-7f83307e234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23ad7e2-ffa1-432e-9519-748b1df78d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23ad7e2-ffa1-432e-9519-748b1df78d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e91b5c33-8762-4f53-9684-d248ebcbfb88', 'volume_name': 'volume-e91b5c33-8762-4f53-9684-d248ebcbfb88', 'volume_size': 1, 'snapshot_id': '3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb79131-fb4f-4ca7-9bde-97ee26d54f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb79131-fb4f-4ca7-9bde-97ee26d54f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074e482e-7884-4ca1-aebd-fa95910fb930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:10 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Volume e91b5c33-8762-4f53-9684-d248ebcbfb88: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e91b5c33-8762-4f53-9684-d248ebcbfb88', 'volume_size': 1, 'snapshot_id': '3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b'} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-quobyte-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b-e91b5c33-8762-4f53-9684-d248ebcbfb88" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b-e91b5c33-8762-4f53-9684-d248ebcbfb88" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Creating volume e91b5c33-8762-4f53-9684-d248ebcbfb88 from snapshot 3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-quobyte-e91b5c33-8762-4f53-9684-d248ebcbfb88" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-e91b5c33-8762-4f53-9684-d248ebcbfb88" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] snapshot: 3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b, volume: e91b5c33-8762-4f53-9684-d248ebcbfb88, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b2ac2-b68d-4503-a3cf-762107cc043b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:10 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b Nov 02 14:36:10 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:10 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" returned: 0 in 0.373s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fefdb0e-fe06-4881-9431-e5b3832b9af8]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:10 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 Nov 02 14:36:10 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:11 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:36:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:36:11 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:36:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:11 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 Nov 02 14:36:11 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=55,cinder:INSERT=11,cinder:UPDATE=60,cinder:DELETE=4 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=68,cinder:SELECT=62,cinder:INSERT=16,cinder:DELETE=8 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (a41bc781-5547-4023-ae1a-1df9c99dd513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e32cac5-82b1-45bf-b2cb-bfef9c813337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e32cac5-82b1-45bf-b2cb-bfef9c813337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1676566378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a648d61b-08a2-42e2-9eca-b822c4a80599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:17Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58ae3ac-975e-49e3-ad21-7491e3a017a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58ae3ac-975e-49e3-ad21-7491e3a017a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f2d803-5b24-451c-8800-88584d551d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f2d803-5b24-451c-8800-88584d551d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a648d61b-08a2-42e2-9eca-b822c4a80599', 'volume_name': 'volume-a648d61b-08a2-42e2-9eca-b822c4a80599', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c96b43-bb35-4713-b334-37f6e1f87626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c96b43-bb35-4713-b334-37f6e1f87626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29098e07-64e3-4111-8e9e-aed0c651fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:17 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Volume a648d61b-08a2-42e2-9eca-b822c4a80599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a648d61b-08a2-42e2-9eca-b822c4a80599', 'volume_size': 1} Nov 02 14:36:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (d6b64f2b-b843-4956-bff4-c8d8d58962ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf94224a-c327-45aa-9cd4-14db8169edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf94224a-c327-45aa-9cd4-14db8169edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79583853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7762ef-2f73-40fe-a740-fe4d6eac72eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:18Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00dc7c5-ca1f-481e-bda1-0ef4a745fbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00dc7c5-ca1f-481e-bda1-0ef4a745fbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc98070e-e343-47ff-9c8d-a15c6fc942ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc98070e-e343-47ff-9c8d-a15c6fc942ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7762ef-2f73-40fe-a740-fe4d6eac72eb', 'volume_name': 'volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13533ff6-2843-4519-8bd4-06d520f6b22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13533ff6-2843-4519-8bd4-06d520f6b22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9efa1aa-4d9a-4f4a-bdaa-c822395d628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Volume 8a7762ef-2f73-40fe-a740-fe4d6eac72eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb', 'volume_size': 1} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:18 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88" returned: 0 in 7.438s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:36:18 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Converted 1024.00 MB image at 137.66 MB/s Nov 02 14:36:18 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 is being set with open permissions: ugo+rw Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:18 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 Nov 02 14:36:18 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (2ab5195b-8b8c-4ae5-9c0a-e2666dc0ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dd343e-d63c-4b77-a035-6163577f4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dd343e-d63c-4b77-a035-6163577f4f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-681436514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3c3c67-1915-4481-8211-d13c542a52b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:19Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d367e327-d5ec-427d-9994-f11b73f36a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d367e327-d5ec-427d-9994-f11b73f36a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59bbc2a-df0a-4655-91fb-bfb1b916bd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59bbc2a-df0a-4655-91fb-bfb1b916bd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3c3c67-1915-4481-8211-d13c542a52b1', 'volume_name': 'volume-9b3c3c67-1915-4481-8211-d13c542a52b1', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3767754-12b7-4617-952f-28f0c877c92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3767754-12b7-4617-952f-28f0c877c92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3a0718-fa6a-4b3e-bc18-dbc376846062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Volume 9b3c3c67-1915-4481-8211-d13c542a52b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3c3c67-1915-4481-8211-d13c542a52b1', 'volume_size': 1} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:18 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88" returned: 0 in 0.279s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-e91b5c33-8762-4f53-9684-d248ebcbfb88" released by "_copy_volume_from_snapshot" :: held 8.548s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b-e91b5c33-8762-4f53-9684-d248ebcbfb88" released by "_create_volume_from_snapshot" :: held 8.627s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.649s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1676566378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a648d61b-08a2-42e2-9eca-b822c4a80599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:17Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Creating volume a648d61b-08a2-42e2-9eca-b822c4a80599 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:18 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:19 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 1073741824 Nov 02 14:36:19 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074e482e-7884-4ca1-aebd-fa95910fb930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91b5c33-8762-4f53-9684-d248ebcbfb88', 'volume_size': 1, 'snapshot_id': '3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff99d400-e976-4c5c-a702-6302321c1f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Volume volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 (e91b5c33-8762-4f53-9684-d248ebcbfb88): created successfully Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff99d400-e976-4c5c-a702-6302321c1f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Flow 'volume_create_manager' (cd3ab45d-fcdd-44de-b2c8-df5d31c8dd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (07fdd7da-16a6-4554-9111-d2599dd183d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23da4f83-a7e1-4ea4-ad24-a8765745749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23da4f83-a7e1-4ea4-ad24-a8765745749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453994098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f9afef-258d-426a-ade2-f7ec40998435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:19Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3de971a-9ecf-4f9a-9b32-3ff630f3f824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3de971a-9ecf-4f9a-9b32-3ff630f3f824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a604f-219b-48bb-93e5-89e3295a2713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5a604f-219b-48bb-93e5-89e3295a2713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f9afef-258d-426a-ade2-f7ec40998435', 'volume_name': 'volume-f8f9afef-258d-426a-ade2-f7ec40998435', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa06ae1d-c059-4c5a-9e48-3e2417320a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa06ae1d-c059-4c5a-9e48-3e2417320a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5774242-826a-4d63-9c78-7f04afcbd85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Volume f8f9afef-258d-426a-ade2-f7ec40998435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f9afef-258d-426a-ade2-f7ec40998435', 'volume_size': 1} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ad7ed118-99c7-41b1-b19c-14e24c310a76 tempest-SnapshotDependencyTests-1643689507 None] Created volume successfully. Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (3755a202-29b1-4666-b03d-eb58257fc16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c157b739-d311-4327-8a22-2ad939f80f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c157b739-d311-4327-8a22-2ad939f80f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72713151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44154f9c-0b44-40ff-b335-df37ab5971bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:19Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a753a10c-0107-4f1f-8da1-8c387950b2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a753a10c-0107-4f1f-8da1-8c387950b2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec20b4e-1281-461d-ae15-7448fdf5d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec20b4e-1281-461d-ae15-7448fdf5d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44154f9c-0b44-40ff-b335-df37ab5971bb', 'volume_name': 'volume-44154f9c-0b44-40ff-b335-df37ab5971bb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a26ef21-1ba0-4627-91f2-6b0071f667b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a26ef21-1ba0-4627-91f2-6b0071f667b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0672e4cd-fa71-4380-b33a-8796b8f8bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Volume 44154f9c-0b44-40ff-b335-df37ab5971bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44154f9c-0b44-40ff-b335-df37ab5971bb', 'volume_size': 1} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 1073741824" returned: 0 in 0.530s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:19 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 Nov 02 14:36:19 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:19 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599" returned: 0 in 0.245s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79583853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7762ef-2f73-40fe-a740-fe4d6eac72eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:18Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Creating volume 8a7762ef-2f73-40fe-a740-fe4d6eac72eb {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:19 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29098e07-64e3-4111-8e9e-aed0c651fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a648d61b-08a2-42e2-9eca-b822c4a80599', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb 1073741824 Nov 02 14:36:19 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b440ba1-c020-4786-8f47-81c37b4e8d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Volume volume-a648d61b-08a2-42e2-9eca-b822c4a80599 (a648d61b-08a2-42e2-9eca-b822c4a80599): created successfully Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b440ba1-c020-4786-8f47-81c37b4e8d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (a41bc781-5547-4023-ae1a-1df9c99dd513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b020c9ab-311d-4ee5-b0f2-b54e42e17556 tempest-CreateVolumesFromImageTest-1815144347 None] Created volume successfully. Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-quobyte-c4a9dba6-9582-478d-b0a5-6b0c48378c50" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-c4a9dba6-9582-478d-b0a5-6b0c48378c50" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-quobyte-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Deleting offline snapshot 3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b of volume c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] snapshot_file for this snap is: volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5513a-3216-4c56-b1ce-f86dd13b1a2a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:20 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb 1073741824" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:20 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b Nov 02 14:36:20 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:20 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb Nov 02 14:36:20 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:20 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb" returned: 0 in 0.264s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-681436514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3c3c67-1915-4481-8211-d13c542a52b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:19Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Creating volume 9b3c3c67-1915-4481-8211-d13c542a52b1 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:20 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:20 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" returned: 0 in 0.393s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:36:20 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 1073741824 Nov 02 14:36:20 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9efa1aa-4d9a-4f4a-bdaa-c822395d628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e52f8-5fff-4495-a147-b805f0383422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4363a5-03c5-4f8c-aa99-6c5a94148468]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:20 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Volume volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb (8a7762ef-2f73-40fe-a740-fe4d6eac72eb): created successfully Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6e52f8-5fff-4495-a147-b805f0383422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (d6b64f2b-b843-4956-bff4-c8d8d58962ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:20 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-338d03bb-7210-4c5f-b87d-f6d08731d393 tempest-CreateVolumesFromImageTest-1815144347 None] Created volume successfully. Nov 02 14:36:20 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 Nov 02 14:36:20 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:20 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 1073741824" returned: 0 in 0.428s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:21 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 Nov 02 14:36:21 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:21 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50" returned: 0 in 0.568s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:21 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b Nov 02 14:36:21 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:21 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1453994098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f9afef-258d-426a-ade2-f7ec40998435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:19Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Creating volume f8f9afef-258d-426a-ade2-f7ec40998435 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:21 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3a0718-fa6a-4b3e-bc18-dbc376846062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3c3c67-1915-4481-8211-d13c542a52b1', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb4b923-84f5-4061-bf14-41e39f499264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:21 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 1073741824 Nov 02 14:36:21 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:21 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Volume volume-9b3c3c67-1915-4481-8211-d13c542a52b1 (9b3c3c67-1915-4481-8211-d13c542a52b1): created successfully Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cb4b923-84f5-4061-bf14-41e39f499264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (2ab5195b-8b8c-4ae5-9c0a-e2666dc0ee99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1d7375be-3505-48d7-a4fa-a3befcd4f046 tempest-CreateVolumesFromImageTest-1815144347 None] Created volume successfully. Nov 02 14:36:21 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" returned: 0 in 0.390s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:21 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b Nov 02 14:36:21 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:21 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 1073741824" returned: 0 in 0.468s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:21 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 Nov 02 14:36:21 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:21 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50.3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b" released by "_delete_snapshot" :: held 1.769s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-c4a9dba6-9582-478d-b0a5-6b0c48378c50" released by "delete_snapshot" :: held 1.795s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:21 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Created reservations ['870c1bda-9f45-4b91-a548-3a8bec419b40', '603c1db6-9d52-4a8c-9383-3b94709f8745', '0058f3c2-8c2b-4547-9214-0e0309446b5d', 'a8ac6343-c8e3-4ca8-8a83-991220b0b6bb'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Delete snapshot completed successfully. Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-cb4a5094-9f7c-4944-8b33-1b1d7d2b047f tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-3b8e4aff-7dc0-482f-80d2-4afaa3e03d7b-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:22 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.572s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-72713151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44154f9c-0b44-40ff-b335-df37ab5971bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0710c5eec044b03abfeafca87f8c6d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:19Z,use_quota=True,user_id='4e944b670acb40eca69090e2528479e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Creating volume 44154f9c-0b44-40ff-b335-df37ab5971bb {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:22 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5774242-826a-4d63-9c78-7f04afcbd85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f9afef-258d-426a-ade2-f7ec40998435', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:22 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb 1073741824 Nov 02 14:36:22 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5272cc-2f29-4bd1-82f9-245cc46ea504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Volume volume-f8f9afef-258d-426a-ade2-f7ec40998435 (f8f9afef-258d-426a-ade2-f7ec40998435): created successfully Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f5272cc-2f29-4bd1-82f9-245cc46ea504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (07fdd7da-16a6-4554-9111-d2599dd183d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8a4ebebe-3d8e-40d4-8514-6820dd691261 tempest-CreateVolumesFromImageTest-1815144347 None] Created volume successfully. Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-c4a9dba6-9582-478d-b0a5-6b0c48378c50-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-c4a9dba6-9582-478d-b0a5-6b0c48378c50-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-quobyte-c4a9dba6-9582-478d-b0a5-6b0c48378c50" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-c4a9dba6-9582-478d-b0a5-6b0c48378c50" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[54882b30-475a-4abf-a275-ed036e46b12b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:22 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 Nov 02 14:36:22 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:22 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb 1073741824" returned: 0 in 0.464s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:22 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb Nov 02 14:36:22 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:22 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50" returned: 0 in 0.385s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:22 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50 Nov 02 14:36:22 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:22 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb" returned: 0 in 0.279s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0672e4cd-fa71-4380-b33a-8796b8f8bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44154f9c-0b44-40ff-b335-df37ab5971bb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8615c289-b640-4201-b30f-2b4a9d8401a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Volume volume-44154f9c-0b44-40ff-b335-df37ab5971bb (44154f9c-0b44-40ff-b335-df37ab5971bb): created successfully Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8615c289-b640-4201-b30f-2b4a9d8401a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Flow 'volume_create_manager' (3755a202-29b1-4666-b03d-eb58257fc16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-82adedff-2112-47ed-b098-39ca71b5320f tempest-CreateVolumesFromImageTest-1815144347 None] Created volume successfully. Nov 02 14:36:23 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c4a9dba6-9582-478d-b0a5-6b0c48378c50" returned: 0 in 0.256s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-c4a9dba6-9582-478d-b0a5-6b0c48378c50" released by "delete_volume" :: held 0.702s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Created reservations ['45a0c20a-fe13-464b-8abb-06af85728dbf', '7037e049-6c33-4a66-bffd-1f5cec5b9cc3', 'a00c3105-521b-446e-9e32-e26e038effc1', '385a0052-0611-4682-ba0c-92ac8061b1ce'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:23 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:23 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:23 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Deleted volume successfully. Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1aa74701-60d9-44ca-8de1-e8207c04fbed tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-c4a9dba6-9582-478d-b0a5-6b0c48378c50-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-e91b5c33-8762-4f53-9684-d248ebcbfb88-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-e91b5c33-8762-4f53-9684-d248ebcbfb88-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "cinder-quobyte-e91b5c33-8762-4f53-9684-d248ebcbfb88" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-e91b5c33-8762-4f53-9684-d248ebcbfb88" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03e851d-97ac-4931-844a-eebf1f67993c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:23 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 Nov 02 14:36:23 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-44154f9c-0b44-40ff-b335-df37ab5971bb-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-44154f9c-0b44-40ff-b335-df37ab5971bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-quobyte-44154f9c-0b44-40ff-b335-df37ab5971bb" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-44154f9c-0b44-40ff-b335-df37ab5971bb" acquired by "delete_volume" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15874b-7548-4806-be69-33b40db160fc]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:24 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88" returned: 0 in 0.425s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:24 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88 Nov 02 14:36:24 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:24 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb Nov 02 14:36:24 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:24 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e91b5c33-8762-4f53-9684-d248ebcbfb88" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-quobyte-e91b5c33-8762-4f53-9684-d248ebcbfb88" released by "delete_volume" :: held 0.865s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Created reservations ['14884a20-37c1-46dc-b55d-a05746e30d47', '9acee4ef-12fd-4b30-971b-8b06c09cea4c', '1030aca5-64f2-4758-a1ce-e5bae6452885', '3736e8e7-1255-4f55-98f2-4f1d99a3e87b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:24 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb" returned: 0 in 0.558s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:24 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb Nov 02 14:36:24 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:24 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:24 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:25 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-44154f9c-0b44-40ff-b335-df37ab5971bb" returned: 0 in 0.469s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-44154f9c-0b44-40ff-b335-df37ab5971bb" released by "delete_volume" :: held 1.091s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Created reservations ['ef333caa-687f-45fb-92e9-1e0b3b9e4a0a', 'd07d1f70-5f11-4223-8101-249338809fe2', 'c27572b1-60b2-4064-8101-5f30a3a05232', '7cc0f44f-d703-437d-84d9-0134974b63c6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:25 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:25 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:25 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.637s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Deleted volume successfully. Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8667f9de-d183-4360-89d0-ae9f79cf3184 tempest-SnapshotDependencyTests-1643689507 None] Lock "cinder-e91b5c33-8762-4f53-9684-d248ebcbfb88-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:25 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.306s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Deleted volume successfully. Nov 02 14:36:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-207f0c20-9b38-434f-b0b6-25a387da81ff tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-44154f9c-0b44-40ff-b335-df37ab5971bb-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-f8f9afef-258d-426a-ade2-f7ec40998435-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-f8f9afef-258d-426a-ade2-f7ec40998435-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-quobyte-f8f9afef-258d-426a-ade2-f7ec40998435" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-f8f9afef-258d-426a-ade2-f7ec40998435" acquired by "delete_volume" :: waited 0.047s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61d3cd-4e7d-4a15-a414-3524aad9cbd6]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-c739d943-e887-471e-8a14-dc16239bf264 tempest-TestShelveInstance-1301275793 None] Terminate volume connection completed successfully. Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-c739d943-e887-471e-8a14-dc16239bf264 tempest-TestShelveInstance-1301275793 None] Deleting attachment 4ac8a935-9b96-42cd-b265-f8b045b5166b. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:36:26 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 Nov 02 14:36:26 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Acquiring lock "cinder-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Lock "cinder-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Acquiring lock "cinder-quobyte-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Lock "cinder-quobyte-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc818ece-f208-4341-999f-8de9223c2432]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:26 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435" returned: 0 in 0.542s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:26 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435 Nov 02 14:36:26 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:27 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d Nov 02 14:36:27 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:27 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f8f9afef-258d-426a-ade2-f7ec40998435" returned: 0 in 0.327s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-f8f9afef-258d-426a-ade2-f7ec40998435" released by "delete_volume" :: held 0.930s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:27 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d" returned: 0 in 0.516s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:27 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d Nov 02 14:36:27 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Created reservations ['2f6bc2a0-df42-4ed5-8b86-896149a78c6b', '096664a3-dab7-47c7-878a-aa9881d24bb3', 'd27db437-a577-410a-a221-5c19ab324311', 'aec9c18a-273f-472c-9110-3a3d13de02f9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:27 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:27 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:27 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Lock "cinder-quobyte-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d" released by "delete_volume" :: held 0.889s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.quota [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Created reservations ['c4fa86d8-084f-407a-8b60-c54bd2470df6', '5a1591cd-fc5d-49ff-9ee4-6a53c0f80f9b', '5ad3ff0b-1dfa-477f-bcd5-f2a6c46ed1f1', '2d246286-37be-44a4-9b54-69b92bffc376'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:27 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.337s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:27 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Deleted volume successfully. Nov 02 14:36:27 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:27 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-450cccda-d9ac-4030-9d2c-b5fb1e13e9af tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-f8f9afef-258d-426a-ade2-f7ec40998435-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:28 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.264s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG cinder.manager [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Deleted volume successfully. Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [req-c60d5e80-1295-43f6-ab7d-cc2d2d6e60e1 req-05037304-81ba-4048-8072-34f9191e9ad7 tempest-TestShelveInstance-1301275793 None] Lock "cinder-d2a4d4e3-42e8-47dd-85e6-697bd0399f8d-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-9b3c3c67-1915-4481-8211-d13c542a52b1-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-9b3c3c67-1915-4481-8211-d13c542a52b1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-quobyte-9b3c3c67-1915-4481-8211-d13c542a52b1" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-9b3c3c67-1915-4481-8211-d13c542a52b1" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fc6580-486a-4938-9291-a93369ff33ba]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:28 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 Nov 02 14:36:28 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:29 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1" returned: 0 in 0.428s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:29 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1 Nov 02 14:36:29 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:29 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9b3c3c67-1915-4481-8211-d13c542a52b1" returned: 0 in 0.305s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-9b3c3c67-1915-4481-8211-d13c542a52b1" released by "delete_volume" :: held 0.786s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Created reservations ['324b931c-67da-47ed-b56b-4509078f091e', 'b76fe469-0319-4463-b06c-35d301e25a3d', 'e05122a2-89dd-40f5-8418-bf92f8f7cc69', '226417b8-bdb1-4162-bb00-8d757a8f32d2'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:29 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:29 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-8a7762ef-2f73-40fe-a740-fe4d6eac72eb-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-8a7762ef-2f73-40fe-a740-fe4d6eac72eb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:29 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.316s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-quobyte-8a7762ef-2f73-40fe-a740-fe4d6eac72eb" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Deleted volume successfully. Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-8a7762ef-2f73-40fe-a740-fe4d6eac72eb" acquired by "delete_volume" :: waited 0.043s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-df187e51-a5ce-4b43-80ba-32b454663942 tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-9b3c3c67-1915-4481-8211-d13c542a52b1-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c84608-8f32-405b-b79b-6ee8a061fc2f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:30 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb Nov 02 14:36:30 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:30 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb" returned: 0 in 0.464s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:30 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb Nov 02 14:36:30 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:30 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a7762ef-2f73-40fe-a740-fe4d6eac72eb" returned: 0 in 0.268s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-8a7762ef-2f73-40fe-a740-fe4d6eac72eb" released by "delete_volume" :: held 0.811s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Created reservations ['5e64ad8b-dbe6-40c6-8a1e-e93c01d4e0c5', 'f733ed57-5e78-47b7-a7af-6a0ebf6a97fb', 'a22d4621-4192-4845-8870-66b50e6726ec', 'f956ba9d-8600-4928-85b1-f6eebfadfe9d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:30 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:30 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-a648d61b-08a2-42e2-9eca-b822c4a80599-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-a648d61b-08a2-42e2-9eca-b822c4a80599-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "cinder-quobyte-a648d61b-08a2-42e2-9eca-b822c4a80599" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-a648d61b-08a2-42e2-9eca-b822c4a80599" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[398629ec-5aef-4340-8155-ef4b8ecb2bb1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:31 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.372s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Deleted volume successfully. Nov 02 14:36:31 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 Nov 02 14:36:31 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2d4f62c2-ff96-49cd-8b3e-3e910382b09b tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-8a7762ef-2f73-40fe-a740-fe4d6eac72eb-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:31 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599" returned: 0 in 0.428s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:31 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599 Nov 02 14:36:31 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:31 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a648d61b-08a2-42e2-9eca-b822c4a80599" returned: 0 in 0.275s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-quobyte-a648d61b-08a2-42e2-9eca-b822c4a80599" released by "delete_volume" :: held 0.760s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:31 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Created reservations ['10758b23-cc0c-473a-9990-646dcdc925a8', 'e8b85047-1c11-49ad-b024-e11cf13a2d25', '3023c33c-ac4c-4488-90fb-b45132c6eeb4', '4b9634f1-aa63-433a-90a5-c0e5d36c3f25'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:32 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:32 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:32 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Deleted volume successfully. Nov 02 14:36:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1f652c93-764f-4780-93a2-4974ef5b9b9c tempest-CreateVolumesFromImageTest-1815144347 None] Lock "cinder-a648d61b-08a2-42e2-9eca-b822c4a80599-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (99407dd6-a32e-41bb-9710-7734ea5d941c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22edb1e-b319-4298-8b2c-ef2a5317ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22edb1e-b319-4298-8b2c-ef2a5317ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-856864537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a98ee6-3783-440b-86de-ac52975d854c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:35Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac294eb-7994-4605-bbe2-abe9d60e3ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac294eb-7994-4605-bbe2-abe9d60e3ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd42e922-8b76-4172-8b4e-9c08885f316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd42e922-8b76-4172-8b4e-9c08885f316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91a98ee6-3783-440b-86de-ac52975d854c', 'volume_name': 'volume-91a98ee6-3783-440b-86de-ac52975d854c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b474596-d891-40ea-a95b-833fb6a8bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b474596-d891-40ea-a95b-833fb6a8bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bc0a6c-ce42-4d2c-99be-b7b39b3a0857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume 91a98ee6-3783-440b-86de-ac52975d854c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91a98ee6-3783-440b-86de-ac52975d854c', 'volume_size': 1} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-856864537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91a98ee6-3783-440b-86de-ac52975d854c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:35Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Creating volume 91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:35 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:35 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c 1073741824 Nov 02 14:36:35 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:36 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c 1073741824" returned: 0 in 0.527s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:36 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c Nov 02 14:36:36 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:36 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c" returned: 0 in 0.303s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17bc0a6c-ce42-4d2c-99be-b7b39b3a0857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91a98ee6-3783-440b-86de-ac52975d854c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c60d08c-29f9-45bc-8482-4727c275e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume volume-91a98ee6-3783-440b-86de-ac52975d854c (91a98ee6-3783-440b-86de-ac52975d854c): created successfully Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c60d08c-29f9-45bc-8482-4727c275e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (99407dd6-a32e-41bb-9710-7734ea5d941c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:36 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-51fddbb4-b63a-4a4f-a160-4a526530325d tempest-CreateVolumesFromSnapshotTest-925630834 None] Created volume successfully. Nov 02 14:36:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Creating offline snapshot fe521d9b-6670-43e4-8bab-a0a9dcaa203b of volume 91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:36:37 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[75165c83-1287-430a-84f9-51802ed3d172]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:38 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c Nov 02 14:36:38 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:38 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c" returned: 0 in 0.403s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:38 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b 1G Nov 02 14:36:38 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:38 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b 1G" returned: 0 in 0.528s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a98ee6-3783-440b-86de-ac52975d854c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:38 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a98ee6-3783-440b-86de-ac52975d854c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b Nov 02 14:36:38 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:39 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:39 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:39 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91a98ee6-3783-440b-86de-ac52975d854c -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b" returned: 0 in 0.352s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:39 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b is being set with open permissions: ugo+rw Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:39 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b Nov 02 14:36:39 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:39 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.305s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:36:39 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b" returned: 0 in 0.315s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:39 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.info Nov 02 14:36:39 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:39 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.info" returned: 0 in 0.273s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:39 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.info is being set with open permissions: ugo+rw Nov 02 14:36:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:39 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.info Nov 02 14:36:39 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:40 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.info" returned: 0 in 0.267s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:40 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d9428474-06a4-4e53-9011-4ca2f2e3eb92 tempest-CreateVolumesFromSnapshotTest-925630834 None] Create snapshot completed successfully Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (024fae12-5bc2-489f-85b3-be2aa1c63e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41c1b5a-4c7e-43fe-8fb6-decefa45c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d41c1b5a-4c7e-43fe-8fb6-decefa45c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938760187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb7ba38-4980-4567-892f-630774ef92cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:41Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e344393a-8f58-4e32-9659-6686b6c411b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e344393a-8f58-4e32-9659-6686b6c411b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467e3cd0-9f65-4c24-a612-043e8e4f4c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467e3cd0-9f65-4c24-a612-043e8e4f4c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb7ba38-4980-4567-892f-630774ef92cd', 'volume_name': 'volume-abb7ba38-4980-4567-892f-630774ef92cd', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b472710-cb25-4c3b-918e-de78288eea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b472710-cb25-4c3b-918e-de78288eea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93d74d8-ad32-4d97-b917-eccf723f55e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:41 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume abb7ba38-4980-4567-892f-630774ef92cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb7ba38-4980-4567-892f-630774ef92cd', 'volume_size': 1} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938760187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb7ba38-4980-4567-892f-630774ef92cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:41Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Creating volume abb7ba38-4980-4567-892f-630774ef92cd {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:41 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:41 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd 1073741824 Nov 02 14:36:41 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:41 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (dfe2bd7d-92db-4240-ad43-2f0cd528c619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e476d7-36b7-45df-8666-a133861389d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40e476d7-36b7-45df-8666-a133861389d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074886627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4447fb01-557d-4953-810a-5b76517e72ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:42Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b14ea6-5f2f-41c9-83f3-627f84770a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b14ea6-5f2f-41c9-83f3-627f84770a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5320ce6-79c1-409a-96ed-86ef14881d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5320ce6-79c1-409a-96ed-86ef14881d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4447fb01-557d-4953-810a-5b76517e72ad', 'volume_name': 'volume-4447fb01-557d-4953-810a-5b76517e72ad', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cc5c5a-13be-44f2-8b3b-7f17135fe440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cc5c5a-13be-44f2-8b3b-7f17135fe440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd727a46-71db-4d9f-8a5e-bcd64ad0154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume 4447fb01-557d-4953-810a-5b76517e72ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4447fb01-557d-4953-810a-5b76517e72ad', 'volume_size': 1} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:42 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd 1073741824" returned: 0 in 0.545s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:42 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd Nov 02 14:36:42 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (59bdf795-153b-4a79-b429-ef7eaee2a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5f85c1-fdea-4f16-9693-3955ca00d00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5f85c1-fdea-4f16-9693-3955ca00d00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-238665342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30be3df-c5ad-45c8-ae3e-8e683bc43c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:42Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88236d6f-afab-4507-a40b-110f7a9b985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88236d6f-afab-4507-a40b-110f7a9b985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f802cab9-0031-447a-b15b-d7f8aefa3a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f802cab9-0031-447a-b15b-d7f8aefa3a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30be3df-c5ad-45c8-ae3e-8e683bc43c6c', 'volume_name': 'volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9280b62-7842-45e0-99f3-76aa407ad7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9280b62-7842-45e0-99f3-76aa407ad7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43019335-6c20-4697-b2b6-9ab4cfeae7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume a30be3df-c5ad-45c8-ae3e-8e683bc43c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c', 'volume_size': 1} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:42 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd" returned: 0 in 0.325s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074886627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4447fb01-557d-4953-810a-5b76517e72ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:42Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Creating volume 4447fb01-557d-4953-810a-5b76517e72ad {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:42 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:42 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad 1073741824 Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93d74d8-ad32-4d97-b917-eccf723f55e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb7ba38-4980-4567-892f-630774ef92cd', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e96b751-549b-4914-b96b-b44ad1034fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume volume-abb7ba38-4980-4567-892f-630774ef92cd (abb7ba38-4980-4567-892f-630774ef92cd): created successfully Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e96b751-549b-4914-b96b-b44ad1034fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (024fae12-5bc2-489f-85b3-be2aa1c63e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e0fea9f2-64d5-4399-b480-bdb09660f627 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created volume successfully. Nov 02 14:36:42 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (a23dc3d9-e07d-4293-ad5b-61d0b610a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ee9237-0a0b-444a-9aba-c034177063b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ee9237-0a0b-444a-9aba-c034177063b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692016842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a466360-6d53-4281-aa23-7b4e052f782a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:43Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3438acb-959f-478a-8a82-d1e3aafe807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3438acb-959f-478a-8a82-d1e3aafe807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e907ccab-bfd3-43c2-b6d2-a6cca24f3790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e907ccab-bfd3-43c2-b6d2-a6cca24f3790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a466360-6d53-4281-aa23-7b4e052f782a', 'volume_name': 'volume-8a466360-6d53-4281-aa23-7b4e052f782a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d22fb95-2739-475b-977f-b54ada3b5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d22fb95-2739-475b-977f-b54ada3b5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6ca20f-b924-447a-bc52-5b63362b08ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume 8a466360-6d53-4281-aa23-7b4e052f782a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a466360-6d53-4281-aa23-7b4e052f782a', 'volume_size': 1} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:43 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad 1073741824" returned: 0 in 0.576s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:43 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad Nov 02 14:36:43 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (76763eba-3f01-4209-abb1-99cbc30e8ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51797f02-db85-45dc-a7ea-9d69672a445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51797f02-db85-45dc-a7ea-9d69672a445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480049909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d442c082-f6fe-49fb-9e92-f92380e9e7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:43Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bfcc17-56b9-4cea-ac85-fe76e183f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bfcc17-56b9-4cea-ac85-fe76e183f744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e895dbdd-0fa3-4cd4-bb9b-0bf442d78104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e895dbdd-0fa3-4cd4-bb9b-0bf442d78104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd442c082-f6fe-49fb-9e92-f92380e9e7e4', 'volume_name': 'volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432afb20-3222-4cac-8f2c-fd79add247db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432afb20-3222-4cac-8f2c-fd79add247db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694b2035-a835-4325-9016-be0eca19990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume d442c082-f6fe-49fb-9e92-f92380e9e7e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4', 'volume_size': 1} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:43 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad" returned: 0 in 0.327s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-238665342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30be3df-c5ad-45c8-ae3e-8e683bc43c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:42Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Creating volume a30be3df-c5ad-45c8-ae3e-8e683bc43c6c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:43 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd727a46-71db-4d9f-8a5e-bcd64ad0154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4447fb01-557d-4953-810a-5b76517e72ad', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c 1073741824 Nov 02 14:36:43 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b4e699-9163-44ce-adbe-f0b0aaf10965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume volume-4447fb01-557d-4953-810a-5b76517e72ad (4447fb01-557d-4953-810a-5b76517e72ad): created successfully Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b4e699-9163-44ce-adbe-f0b0aaf10965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (dfe2bd7d-92db-4240-ad43-2f0cd528c619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0fa04843-0e71-4fb3-ba95-f0580f3f08a6 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created volume successfully. Nov 02 14:36:44 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c 1073741824" returned: 0 in 0.487s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:44 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c Nov 02 14:36:44 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:44 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.267s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692016842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a466360-6d53-4281-aa23-7b4e052f782a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:43Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Creating volume 8a466360-6d53-4281-aa23-7b4e052f782a {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:44 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43019335-6c20-4697-b2b6-9ab4cfeae7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:44 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a 1073741824 Nov 02 14:36:44 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d714ee-506b-45e5-b139-f38ebb02121e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c (a30be3df-c5ad-45c8-ae3e-8e683bc43c6c): created successfully Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d714ee-506b-45e5-b139-f38ebb02121e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (59bdf795-153b-4a79-b429-ef7eaee2a90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-853774e6-9eb9-4be3-9ea7-2a95dec7a5b1 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created volume successfully. Nov 02 14:36:44 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a 1073741824" returned: 0 in 0.451s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:44 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a Nov 02 14:36:44 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:45 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a" returned: 0 in 0.262s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480049909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d442c082-f6fe-49fb-9e92-f92380e9e7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef80d3650eb489683aeaea5766e52db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:43Z,use_quota=True,user_id='e7a331a94fc546939ddde83ec9b7fcde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Creating volume d442c082-f6fe-49fb-9e92-f92380e9e7e4 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:45 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6ca20f-b924-447a-bc52-5b63362b08ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a466360-6d53-4281-aa23-7b4e052f782a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335629ad-52cb-460a-b4e2-ae250edb7496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:45 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 1073741824 Nov 02 14:36:45 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume volume-8a466360-6d53-4281-aa23-7b4e052f782a (8a466360-6d53-4281-aa23-7b4e052f782a): created successfully Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335629ad-52cb-460a-b4e2-ae250edb7496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (a23dc3d9-e07d-4293-ad5b-61d0b610a22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-09f44b70-3ac2-4e89-a51c-ba7ebc590a4e tempest-CreateVolumesFromSnapshotTest-925630834 None] Created volume successfully. Nov 02 14:36:45 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 1073741824" returned: 0 in 0.509s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:45 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 Nov 02 14:36:45 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:45 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4" returned: 0 in 0.248s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694b2035-a835-4325-9016-be0eca19990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff24fb83-fcbb-471a-9574-ac4b99c8b5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Volume volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 (d442c082-f6fe-49fb-9e92-f92380e9e7e4): created successfully Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff24fb83-fcbb-471a-9574-ac4b99c8b5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Flow 'volume_create_manager' (76763eba-3f01-4209-abb1-99cbc30e8ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-206cae02-a4f5-4020-b47e-3418fde9ba8f tempest-CreateVolumesFromSnapshotTest-925630834 None] Created volume successfully. Nov 02 14:36:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-d442c082-f6fe-49fb-9e92-f92380e9e7e4-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-d442c082-f6fe-49fb-9e92-f92380e9e7e4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-d442c082-f6fe-49fb-9e92-f92380e9e7e4" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-d442c082-f6fe-49fb-9e92-f92380e9e7e4" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cdf6f9-e77b-4188-a4fe-ba603b04eff3]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:47 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 Nov 02 14:36:47 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:47 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4" returned: 0 in 0.488s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:47 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4 Nov 02 14:36:47 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:47 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d442c082-f6fe-49fb-9e92-f92380e9e7e4" returned: 0 in 0.257s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-d442c082-f6fe-49fb-9e92-f92380e9e7e4" released by "delete_volume" :: held 0.798s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created reservations ['f586b44a-6dfc-4d3e-9b9f-566ff4ac7929', '2ae06795-9dc3-4265-9ac4-9ba3bd950e42', '64f3d3dd-f0b8-46e7-b794-30198d17b77d', 'e3b14e00-5498-4d59-aa57-24a84768d5cf'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:47 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:47 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-8a466360-6d53-4281-aa23-7b4e052f782a-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-8a466360-6d53-4281-aa23-7b4e052f782a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-8a466360-6d53-4281-aa23-7b4e052f782a" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-8a466360-6d53-4281-aa23-7b4e052f782a" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:48 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.309s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Deleted volume successfully. Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[591a739d-1a6d-480e-8971-cf896640166c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f7682b69-442c-4d8d-8ca8-eaa5db629823 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-d442c082-f6fe-49fb-9e92-f92380e9e7e4-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:48 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a Nov 02 14:36:48 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:48 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a" returned: 0 in 0.380s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:48 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a Nov 02 14:36:48 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:48 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8a466360-6d53-4281-aa23-7b4e052f782a" returned: 0 in 0.262s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-8a466360-6d53-4281-aa23-7b4e052f782a" released by "delete_volume" :: held 0.706s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created reservations ['6c7624d7-1ebb-4896-b91a-febe1412785e', '4b7799b7-1bce-4e08-83ec-9da9b586d087', 'f280d61e-9268-4ba8-b01a-8e965d2e4ccd', '5e10b775-fc18-48a4-a3b8-6dce30a10ca8'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:48 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:48 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:49 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Deleted volume successfully. Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-de531127-d84c-4d20-a251-936b19bd56f2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-8a466360-6d53-4281-aa23-7b4e052f782a-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c" acquired by "delete_volume" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4f9c1-4b54-403f-a979-137173b7cb27]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:49 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c Nov 02 14:36:49 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:49 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:49 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c Nov 02 14:36:49 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:50 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c" returned: 0 in 0.257s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c" released by "delete_volume" :: held 0.752s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created reservations ['b8e014d7-1731-473e-b08d-11934a0d9439', '6c1e752a-6a08-4f32-8605-03d9c1a73dd4', 'd3d99e2d-70a4-45e8-96bc-c9acdb28a663', '6b1fd535-ac27-49cc-bade-830a6d8e6784'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:50 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:50 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-4447fb01-557d-4953-810a-5b76517e72ad-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-4447fb01-557d-4953-810a-5b76517e72ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:50 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.302s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-4447fb01-557d-4953-810a-5b76517e72ad" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Deleted volume successfully. Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-4447fb01-557d-4953-810a-5b76517e72ad" acquired by "delete_volume" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3fc9c46-107b-42e1-b541-fe167b149e67 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-a30be3df-c5ad-45c8-ae3e-8e683bc43c6c-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baaecc0-0d3b-4e9a-a3b0-b8a458743d15]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:50 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad Nov 02 14:36:50 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:50 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad" returned: 0 in 0.375s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:50 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad Nov 02 14:36:50 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:51 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4447fb01-557d-4953-810a-5b76517e72ad" returned: 0 in 0.255s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-4447fb01-557d-4953-810a-5b76517e72ad" released by "delete_volume" :: held 0.680s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created reservations ['fd18bb27-92f9-4083-820e-73a7d5b2bcee', '08e800a3-2bf0-46f2-8e9a-985a4bf9d9a9', '4cf95a5d-347d-4d19-b0af-67938ed9bfeb', 'bf8403c6-5c2d-4c61-958a-8677773ffa12'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:51 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:51 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:51 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.255s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Deleted volume successfully. Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-abb7ba38-4980-4567-892f-630774ef92cd-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ee4dada-69a9-4190-810a-eac0220b9be5 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-4447fb01-557d-4953-810a-5b76517e72ad-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-abb7ba38-4980-4567-892f-630774ef92cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-abb7ba38-4980-4567-892f-630774ef92cd" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-abb7ba38-4980-4567-892f-630774ef92cd" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ac1fd8-3333-44d4-85e5-d72153100e7d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:51 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd Nov 02 14:36:51 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:52 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:52 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd Nov 02 14:36:52 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:52 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abb7ba38-4980-4567-892f-630774ef92cd" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-abb7ba38-4980-4567-892f-630774ef92cd" released by "delete_volume" :: held 0.706s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created reservations ['03c8aac7-60f4-4b0f-a0e6-e06b17ff5e6a', '4e004ba6-18f0-497a-b544-80a44da6c9bf', '50a5eec7-9d21-4eee-8ae1-388208b45a02', 'c7a7eb09-6665-4670-8455-7f1bef69ed40'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:52 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:52 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:52 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-fe521d9b-6670-43e4-8bab-a0a9dcaa203b-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.293s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Deleted volume successfully. Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-fe521d9b-6670-43e4-8bab-a0a9dcaa203b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-91a98ee6-3783-440b-86de-ac52975d854c" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-321ed57a-173b-4bfa-8272-8a1a8e76d7a2 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-abb7ba38-4980-4567-892f-630774ef92cd-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-91a98ee6-3783-440b-86de-ac52975d854c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-fe521d9b-6670-43e4-8bab-a0a9dcaa203b" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-fe521d9b-6670-43e4-8bab-a0a9dcaa203b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Deleting offline snapshot fe521d9b-6670-43e4-8bab-a0a9dcaa203b of volume 91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] snapshot_file for this snap is: volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[734836f5-b6a7-4425-a63c-5c9c3ac3d52a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:53 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b Nov 02 14:36:53 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:53 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b" returned: 0 in 0.505s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91a98ee6-3783-440b-86de-ac52975d854c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:36:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac80705-0795-408d-8319-f7500c81c0bb]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:53 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c Nov 02 14:36:53 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:53 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:53 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b Nov 02 14:36:53 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:54 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:54 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b Nov 02 14:36:54 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:54 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c.fe521d9b-6670-43e4-8bab-a0a9dcaa203b" returned: 0 in 0.289s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-fe521d9b-6670-43e4-8bab-a0a9dcaa203b" released by "_delete_snapshot" :: held 1.680s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-91a98ee6-3783-440b-86de-ac52975d854c" released by "delete_snapshot" :: held 1.712s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created reservations ['8c9045d5-9b6e-4d5d-a569-1f955ce4387a', 'cdaaa0d5-76e9-4ab0-a6be-ea114af5f2b0', 'b3339426-b9d7-430c-ad24-bd9deab4d71a', '4bdfac00-7300-4a1d-b3d9-2e7f531f8802'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Delete snapshot completed successfully. Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9a24def0-4c34-4e3f-883e-a37f9a4e72a4 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-fe521d9b-6670-43e4-8bab-a0a9dcaa203b-delete_snapshot" released by "delete_snapshot" :: held 1.870s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-91a98ee6-3783-440b-86de-ac52975d854c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-91a98ee6-3783-440b-86de-ac52975d854c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "cinder-quobyte-91a98ee6-3783-440b-86de-ac52975d854c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-91a98ee6-3783-440b-86de-ac52975d854c" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c591110f-80dd-4c6e-88ba-62527f23a681]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:55 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c Nov 02 14:36:55 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:55 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c" returned: 0 in 0.399s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:55 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c Nov 02 14:36:55 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:55 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91a98ee6-3783-440b-86de-ac52975d854c" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-quobyte-91a98ee6-3783-440b-86de-ac52975d854c" released by "delete_volume" :: held 0.723s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Created reservations ['5df309dc-30a2-4a70-887f-79b6cb702b16', '50e2308c-f10a-47de-a704-86bf5a701668', '0d4f7b7e-420d-4721-95d3-b671279cff05', '8594faa5-3112-4e2e-af85-7ee163123719'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:55 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:36:55 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:56 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:56 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:36:56 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Deleted volume successfully. Nov 02 14:36:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-12bf429e-7271-4866-b60b-2e5cbc1c1830 tempest-CreateVolumesFromSnapshotTest-925630834 None] Lock "cinder-91a98ee6-3783-440b-86de-ac52975d854c-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Flow 'volume_create_manager' (e0277b82-4150-45e7-a727-2fe5e801bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879c57d5-cdab-47db-951d-a8e0a6977db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (879c57d5-cdab-47db-951d-a8e0a6977db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-652685849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97256ef-1e65-4f39-b05c-7ca5711339b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f6353bb10c405a889610f301d64e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:59Z,use_quota=True,user_id='6ae874041f9749809d875a2abdbd0ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7417f-3335-401c-be79-543b8d679eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7417f-3335-401c-be79-543b8d679eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b81835-87f1-4478-baec-3fafaeedc40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b81835-87f1-4478-baec-3fafaeedc40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97256ef-1e65-4f39-b05c-7ca5711339b3', 'volume_name': 'volume-e97256ef-1e65-4f39-b05c-7ca5711339b3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc213f8b-f1e9-4a22-82df-4f8595a0b7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc213f8b-f1e9-4a22-82df-4f8595a0b7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837a6df6-face-488e-becb-efa97fd86718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:36:59 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Volume e97256ef-1e65-4f39-b05c-7ca5711339b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97256ef-1e65-4f39-b05c-7ca5711339b3', 'volume_size': 1} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-652685849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97256ef-1e65-4f39-b05c-7ca5711339b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f6353bb10c405a889610f301d64e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:36:59Z,use_quota=True,user_id='6ae874041f9749809d875a2abdbd0ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Creating volume e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:36:59 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:59 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 1073741824 Nov 02 14:36:59 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:36:59 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 1073741824" returned: 0 in 0.479s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:36:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:36:59 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 Nov 02 14:36:59 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:00 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3" returned: 0 in 0.255s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:37:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837a6df6-face-488e-becb-efa97fd86718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97256ef-1e65-4f39-b05c-7ca5711339b3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43ace12-1056-47ea-b31c-19c6e1c83b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:00 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Volume volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 (e97256ef-1e65-4f39-b05c-7ca5711339b3): created successfully Nov 02 14:37:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43ace12-1056-47ea-b31c-19c6e1c83b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Flow 'volume_create_manager' (e0277b82-4150-45e7-a727-2fe5e801bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e74fc5e2-3f26-42a9-a783-447bacb9a6f6 tempest-VolumeDependencyTests-470800234 None] Created volume successfully. Nov 02 14:37:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Creating offline snapshot e3737d08-a2d6-498d-80cf-2d7d957253d0 of volume e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:37:01 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d617b96b-0ab2-4607-b781-95027b1149d5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:01 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 Nov 02 14:37:01 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:01 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3" returned: 0 in 0.375s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:01 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 1G Nov 02 14:37:01 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:02 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 1G" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:02 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 Nov 02 14:37:02 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:02 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0" returned: 0 in 0.319s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:02 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 is being set with open permissions: ugo+rw Nov 02 14:37:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:02 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 Nov 02 14:37:02 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:02 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0" returned: 0 in 0.256s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:02 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.info Nov 02 14:37:02 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:03 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.info" returned: 0 in 0.263s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:03 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.info is being set with open permissions: ugo+rw Nov 02 14:37:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:03 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.info Nov 02 14:37:03 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:03 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.info" returned: 0 in 0.279s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-05fbaede-a2f3-467f-93bf-292f0d7c94a3 tempest-VolumeDependencyTests-470800234 None] Create snapshot completed successfully Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Flow 'volume_create_manager' (940bfb79-acec-45f5-b3aa-cf902b3265c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ed03dc-643f-4c40-beaf-60ce660eb0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ed03dc-643f-4c40-beaf-60ce660eb0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2065978733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c53cf77e-f3fc-475e-aa12-c3979a11c08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f6353bb10c405a889610f301d64e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3737d08-a2d6-498d-80cf-2d7d957253d0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:37:05Z,use_quota=True,user_id='6ae874041f9749809d875a2abdbd0ef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a54740-31c4-4a02-b312-af886ab46776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a54740-31c4-4a02-b312-af886ab46776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c13914-7c25-42df-acb1-e98c9678cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c13914-7c25-42df-acb1-e98c9678cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c53cf77e-f3fc-475e-aa12-c3979a11c08e', 'volume_name': 'volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e', 'volume_size': 1, 'snapshot_id': 'e3737d08-a2d6-498d-80cf-2d7d957253d0'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52d4837-e9da-4260-871c-0d6bbf50b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52d4837-e9da-4260-871c-0d6bbf50b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82977852-b6f8-4db7-9c1b-e7960ef264f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Volume c53cf77e-f3fc-475e-aa12-c3979a11c08e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e', 'volume_size': 1, 'snapshot_id': 'e3737d08-a2d6-498d-80cf-2d7d957253d0'} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Flow 'volume_create_manager' (0cd79d7a-49d3-49eb-9dfd-42676f112f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef5a61e-ac1f-4e1a-955a-6cd29a73e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-quobyte-e3737d08-a2d6-498d-80cf-2d7d957253d0-c53cf77e-f3fc-475e-aa12-c3979a11c08e" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef5a61e-ac1f-4e1a-955a-6cd29a73e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-166216666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ab9950-2646-4490-8ff2-7086fcf038f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf0ab25c2804209a72bb5b029741622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:37:05Z,use_quota=True,user_id='7b43c79e97ac45dfafa8a936fa450a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fc27fb-f82d-4680-87e1-174e99f6fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fc27fb-f82d-4680-87e1-174e99f6fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924772a9-8c06-4575-aa9b-929400987e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924772a9-8c06-4575-aa9b-929400987e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ab9950-2646-4490-8ff2-7086fcf038f1', 'volume_name': 'volume-17ab9950-2646-4490-8ff2-7086fcf038f1', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7859bab-a320-4321-a7ea-a14e6c06a6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7859bab-a320-4321-a7ea-a14e6c06a6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb517025-2ddd-44b1-9e21-efc0240d6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:05 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Volume 17ab9950-2646-4490-8ff2-7086fcf038f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ab9950-2646-4490-8ff2-7086fcf038f1', 'volume_size': 1} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e3737d08-a2d6-498d-80cf-2d7d957253d0-c53cf77e-f3fc-475e-aa12-c3979a11c08e" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Creating volume c53cf77e-f3fc-475e-aa12-c3979a11c08e from snapshot e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-quobyte-c53cf77e-f3fc-475e-aa12-c3979a11c08e" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-c53cf77e-f3fc-475e-aa12-c3979a11c08e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] snapshot: e3737d08-a2d6-498d-80cf-2d7d957253d0, volume: c53cf77e-f3fc-475e-aa12-c3979a11c08e, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dea6e8a-ce2a-4f8b-a179-0954e6e30a6d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:05 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 Nov 02 14:37:05 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:05 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0" returned: 0 in 0.354s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e97256ef-1e65-4f39-b05c-7ca5711339b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a37a0f-8407-4d27-804a-272ca960f25a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:06 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 Nov 02 14:37:06 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:06 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3" returned: 0 in 0.363s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:37:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:37:06 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:37:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:06 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e Nov 02 14:37:06 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:12 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e" returned: 0 in 6.056s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:37:12 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Converted 1024.00 MB image at 169.07 MB/s Nov 02 14:37:12 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e is being set with open permissions: ugo+rw Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:12 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e Nov 02 14:37:12 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:12 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e" returned: 0 in 0.232s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-c53cf77e-f3fc-475e-aa12-c3979a11c08e" released by "_copy_volume_from_snapshot" :: held 7.083s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e3737d08-a2d6-498d-80cf-2d7d957253d0-c53cf77e-f3fc-475e-aa12-c3979a11c08e" released by "_create_volume_from_snapshot" :: held 7.140s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.193s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.150s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-166216666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ab9950-2646-4490-8ff2-7086fcf038f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddf0ab25c2804209a72bb5b029741622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:37:05Z,use_quota=True,user_id='7b43c79e97ac45dfafa8a936fa450a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Creating volume 17ab9950-2646-4490-8ff2-7086fcf038f1 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:37:12 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:12 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 1073741824 Nov 02 14:37:12 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82977852-b6f8-4db7-9c1b-e7960ef264f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e', 'volume_size': 1, 'snapshot_id': 'e3737d08-a2d6-498d-80cf-2d7d957253d0'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30308027-4bbc-47d2-9aba-6306b76d5121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:12 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Volume volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e (c53cf77e-f3fc-475e-aa12-c3979a11c08e): created successfully Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30308027-4bbc-47d2-9aba-6306b76d5121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Flow 'volume_create_manager' (940bfb79-acec-45f5-b3aa-cf902b3265c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:12 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e85883f5-9d46-47a2-9ddb-f400c08295b0 tempest-VolumeDependencyTests-470800234 None] Created volume successfully. Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-e3737d08-a2d6-498d-80cf-2d7d957253d0-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Lock "cinder-e3737d08-a2d6-498d-80cf-2d7d957253d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-quobyte-e97256ef-1e65-4f39-b05c-7ca5711339b3" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e97256ef-1e65-4f39-b05c-7ca5711339b3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-quobyte-e3737d08-a2d6-498d-80cf-2d7d957253d0" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e3737d08-a2d6-498d-80cf-2d7d957253d0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Deleting offline snapshot e3737d08-a2d6-498d-80cf-2d7d957253d0 of volume e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:37:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] snapshot_file for this snap is: volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d42c886-3f72-4d7e-b1f7-7daac98bbc94]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:13 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 Nov 02 14:37:13 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:13 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 1073741824" returned: 0 in 0.446s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:13 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 Nov 02 14:37:13 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:13 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0" returned: 0 in 0.371s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e97256ef-1e65-4f39-b05c-7ca5711339b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee83737-bc31-4fa3-9d69-c401d8ee41f1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:13 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb517025-2ddd-44b1-9e21-efc0240d6f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ab9950-2646-4490-8ff2-7086fcf038f1', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac8abf6-bf90-4489-99c8-3b1efc9fcce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:13 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Volume volume-17ab9950-2646-4490-8ff2-7086fcf038f1 (17ab9950-2646-4490-8ff2-7086fcf038f1): created successfully Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac8abf6-bf90-4489-99c8-3b1efc9fcce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Flow 'volume_create_manager' (0cd79d7a-49d3-49eb-9dfd-42676f112f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-aa6494fb-d3f2-4dca-8893-5fc24073ee93 tempest-TestImageHashVerification-967869708 None] Created volume successfully. Nov 02 14:37:13 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 Nov 02 14:37:13 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:13 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3" returned: 0 in 0.510s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:13 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 Nov 02 14:37:13 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:14 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0" returned: 0 in 0.351s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:14 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0 Nov 02 14:37:14 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:14 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3.e3737d08-a2d6-498d-80cf-2d7d957253d0" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e3737d08-a2d6-498d-80cf-2d7d957253d0" released by "_delete_snapshot" :: held 1.585s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e97256ef-1e65-4f39-b05c-7ca5711339b3" released by "delete_snapshot" :: held 1.609s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Created reservations ['972c25d5-ca87-4efe-8b8f-2d90084e7f55', '3de0909c-3a2e-4962-ad05-441f15d69554', '6c015d86-a3f0-428e-8bb7-76447ab798ae', 'bbde2c89-39b4-469e-9358-ac7ff6717ddc'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:37:14 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Delete snapshot completed successfully. Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3dad3a71-308d-4459-aa47-ef32c85f9c9e tempest-VolumeDependencyTests-470800234 None] Lock "cinder-e3737d08-a2d6-498d-80cf-2d7d957253d0-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[46828139-cb4a-489f-a4f0-365ee424a107]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:15 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 Nov 02 14:37:15 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-e97256ef-1e65-4f39-b05c-7ca5711339b3-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-e97256ef-1e65-4f39-b05c-7ca5711339b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-quobyte-e97256ef-1e65-4f39-b05c-7ca5711339b3" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e97256ef-1e65-4f39-b05c-7ca5711339b3" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0339e59-7a9a-4783-a9ea-4837b4cb470e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:15 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1" returned: 0 in 0.371s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b6ef9-9c31-4f55-8ab0-fbd146ced707]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:15 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 Nov 02 14:37:15 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:15 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 Nov 02 14:37:15 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:15 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3" returned: 0 in 0.364s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:15 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3 Nov 02 14:37:15 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:15 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1" returned: 0 in 0.371s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 /opt/stack/data/cinder/conversion/17ab9950-2646-4490-8ff2-7086fcf038f1.temp_image.c0e75683-97e5-4547-9f0a-69c843d87593j08vt4z8.img {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:15 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 /opt/stack/data/cinder/conversion/17ab9950-2646-4490-8ff2-7086fcf038f1.temp_image.c0e75683-97e5-4547-9f0a-69c843d87593j08vt4z8.img Nov 02 14:37:15 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:15 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e97256ef-1e65-4f39-b05c-7ca5711339b3" returned: 0 in 0.251s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-e97256ef-1e65-4f39-b05c-7ca5711339b3" released by "delete_volume" :: held 0.680s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Created reservations ['ee9d1ebb-1856-4b29-afa8-3773093d3124', '508f2170-2660-466a-8950-a9524c68f871', 'f5cb40a9-0ad5-4d6c-ba92-d60ce59dfa6f', '1f2ec310-10a5-4164-baa2-2528bd57dfb5'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:15 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:37:15 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:16 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.373s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:37:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Deleted volume successfully. Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-c53cf77e-f3fc-475e-aa12-c3979a11c08e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9ff58ccd-6eb7-49f6-befd-d5aed6057dc0 tempest-VolumeDependencyTests-470800234 None] Lock "cinder-e97256ef-1e65-4f39-b05c-7ca5711339b3-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Lock "cinder-c53cf77e-f3fc-475e-aa12-c3979a11c08e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Acquiring lock "cinder-quobyte-c53cf77e-f3fc-475e-aa12-c3979a11c08e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-c53cf77e-f3fc-475e-aa12-c3979a11c08e" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[256724f2-643c-4a05-8574-c7fb8eb8ab7a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:16 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e Nov 02 14:37:16 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:17 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e" returned: 0 in 0.548s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:17 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e Nov 02 14:37:17 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:17 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c53cf77e-f3fc-475e-aa12-c3979a11c08e" returned: 0 in 0.319s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Lock "cinder-quobyte-c53cf77e-f3fc-475e-aa12-c3979a11c08e" released by "delete_volume" :: held 0.942s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=133,cinder:UPDATE=187,cinder:INSERT=31,cinder:DELETE=12 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=134,cinder:UPDATE=181,cinder:INSERT=58,cinder:DELETE=20 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Created reservations ['85a328dc-e88a-41ea-b6fa-efae9f0c517b', '27b50fa9-20c5-4724-adba-46ad66ef2470', 'b009af1d-990f-49e6-b7c3-159bd6fb62a1', '1ee4ecb2-0ed4-4076-a2f7-46fa5aeb44ce'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:17 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:37:17 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:18 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.352s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:18 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:37:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Deleted volume successfully. Nov 02 14:37:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4c1292e9-5f5d-4f80-9155-e8a60b499efa tempest-VolumeDependencyTests-470800234 None] Lock "cinder-c53cf77e-f3fc-475e-aa12-c3979a11c08e-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:22 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 /opt/stack/data/cinder/conversion/17ab9950-2646-4490-8ff2-7086fcf038f1.temp_image.c0e75683-97e5-4547-9f0a-69c843d87593j08vt4z8.img" returned: 0 in 6.694s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:22 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6d34c-9773-4779-b8c5-4b674093e896]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:22 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 Nov 02 14:37:22 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:22 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1" returned: 0 in 0.515s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:22 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/conversion/17ab9950-2646-4490-8ff2-7086fcf038f1.temp_image.c0e75683-97e5-4547-9f0a-69c843d87593j08vt4z8.img {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:37:22 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Converted 1024.00 MB image at 152.96 MB/s Nov 02 14:37:22 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] c0e75683-97e5-4547-9f0a-69c843d87593 was raw, no need to convert to raw {{(pid=86978) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Flow 'volume_create_manager' (b6f3d9a7-eee2-4bb3-89f3-623409b3f128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213a1c21-df06-4ffd-8502-fb239f2e2e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213a1c21-df06-4ffd-8502-fb239f2e2e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f130315f-4929-4a98-8196-14f379f6fc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f86c2ac71ca498d8d9747292a9874b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:37:23Z,use_quota=True,user_id='1acf638e0246406094efaedbe938144a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a116cce1-14e1-4df8-8d07-127b739c30a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a116cce1-14e1-4df8-8d07-127b739c30a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c242158-b06f-4f3b-838d-cc58b6ee1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c242158-b06f-4f3b-838d-cc58b6ee1732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f130315f-4929-4a98-8196-14f379f6fc52', 'volume_name': 'volume-f130315f-4929-4a98-8196-14f379f6fc52', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561ee6bb-8606-4b31-a471-3556b3c98dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561ee6bb-8606-4b31-a471-3556b3c98dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292a35b7-42fc-4312-b2c6-a1f96ff08cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Volume f130315f-4929-4a98-8196-14f379f6fc52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f130315f-4929-4a98-8196-14f379f6fc52', 'volume_size': 1} Nov 02 14:37:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:33 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:37:33 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:39 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:37:39 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:39 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:37:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.887s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Uploaded volume to glance image-id: c0e75683-97e5-4547-9f0a-69c843d87593. {{(pid=86978) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.276s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f130315f-4929-4a98-8196-14f379f6fc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f86c2ac71ca498d8d9747292a9874b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:37:23Z,use_quota=True,user_id='1acf638e0246406094efaedbe938144a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Creating volume f130315f-4929-4a98-8196-14f379f6fc52 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:37:41 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:37:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:41 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 1073741824 Nov 02 14:37:41 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:41 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e51aa1dd-c829-4f26-b679-a1e2ede1ce5c tempest-TestImageHashVerification-967869708 None] Copy volume to image completed successfully. Nov 02 14:37:42 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 1073741824" returned: 0 in 0.450s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:42 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 Nov 02 14:37:42 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Acquiring lock "cinder-17ab9950-2646-4490-8ff2-7086fcf038f1-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Lock "cinder-17ab9950-2646-4490-8ff2-7086fcf038f1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Acquiring lock "cinder-quobyte-17ab9950-2646-4490-8ff2-7086fcf038f1" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Lock "cinder-quobyte-17ab9950-2646-4490-8ff2-7086fcf038f1" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[31430417-3db6-477e-811c-ed01373ef381]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:42 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292a35b7-42fc-4312-b2c6-a1f96ff08cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f130315f-4929-4a98-8196-14f379f6fc52', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6013eb-26f0-42aa-bba4-f8a453ad847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Volume volume-f130315f-4929-4a98-8196-14f379f6fc52 (f130315f-4929-4a98-8196-14f379f6fc52): created successfully Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6013eb-26f0-42aa-bba4-f8a453ad847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Flow 'volume_create_manager' (b6f3d9a7-eee2-4bb3-89f3-623409b3f128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4025acbe-7016-4069-968b-0bb11b4bda50 tempest-CinderUnicodeTest-2106010956 None] Created volume successfully. Nov 02 14:37:42 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 Nov 02 14:37:42 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:42 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:42 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1 Nov 02 14:37:42 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:43 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-17ab9950-2646-4490-8ff2-7086fcf038f1" returned: 0 in 0.239s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Lock "cinder-quobyte-17ab9950-2646-4490-8ff2-7086fcf038f1" released by "delete_volume" :: held 0.642s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Created reservations ['485ab834-a317-46df-aafb-931354e33353', 'b3f22874-a0ee-4759-9f3e-1763900ce925', '0ce6e664-fc24-460a-9607-7ca7a543ecc5', '974a7a6b-14fd-419b-bc59-2877eb19c28b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:43 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:37:43 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:43 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.240s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:37:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Deleted volume successfully. Nov 02 14:37:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-305ec090-fe82-4a43-b4d1-19568cfaaa11 tempest-TestImageHashVerification-967869708 None] Lock "cinder-17ab9950-2646-4490-8ff2-7086fcf038f1-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Flow 'volume_create_manager' (e0aa7e38-3ef8-4ad0-b710-f7559a137906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5520b08f-0477-46ea-9104-4d780a4f984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5520b08f-0477-46ea-9104-4d780a4f984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:37:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-305776211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da480303-7b10-4d16-ad3b-c1ca2d1b85bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f86c2ac71ca498d8d9747292a9874b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:37:44Z,use_quota=True,user_id='1acf638e0246406094efaedbe938144a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c1bf20-5328-40a0-a52d-5ba2929dbb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c1bf20-5328-40a0-a52d-5ba2929dbb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6679227-7398-4b64-8389-e002ad9bbdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6679227-7398-4b64-8389-e002ad9bbdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da480303-7b10-4d16-ad3b-c1ca2d1b85bb', 'volume_name': 'volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee07b64c-4abf-42a9-9373-c0b66adc7078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee07b64c-4abf-42a9-9373-c0b66adc7078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132da6e3-4790-4b01-9de7-8d12ad023096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:44 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Volume da480303-7b10-4d16-ad3b-c1ca2d1b85bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb', 'volume_size': 1} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:37:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-305776211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da480303-7b10-4d16-ad3b-c1ca2d1b85bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f86c2ac71ca498d8d9747292a9874b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:37:44Z,use_quota=True,user_id='1acf638e0246406094efaedbe938144a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Creating volume da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:37:44 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:44 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb 1073741824 Nov 02 14:37:44 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:44 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb 1073741824" returned: 0 in 0.447s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:44 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb Nov 02 14:37:44 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:45 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" returned: 0 in 0.283s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:37:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132da6e3-4790-4b01-9de7-8d12ad023096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb57179-00d6-4461-a1cd-c49a57855a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:37:45 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Volume volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb (da480303-7b10-4d16-ad3b-c1ca2d1b85bb): created successfully Nov 02 14:37:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb57179-00d6-4461-a1cd-c49a57855a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:37:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Flow 'volume_create_manager' (e0aa7e38-3ef8-4ad0-b710-f7559a137906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:37:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f63c5209-6f15-46bb-b64e-9b9a82328961 tempest-CinderUnicodeTest-2106010956 None] Created volume successfully. Nov 02 14:37:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Creating offline snapshot b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 of volume da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:37:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7bb54a-81c3-463e-86a7-86d949ce79f2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:46 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb Nov 02 14:37:46 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:46 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" returned: 0 in 0.430s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:46 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 1G Nov 02 14:37:46 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:47 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 1G" returned: 0 in 0.406s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:47 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 Nov 02 14:37:47 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:47 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" returned: 0 in 0.296s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:47 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 is being set with open permissions: ugo+rw Nov 02 14:37:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:47 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 Nov 02 14:37:47 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:47 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:47 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.info Nov 02 14:37:47 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:48 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.info" returned: 0 in 0.261s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:48 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.info is being set with open permissions: ugo+rw Nov 02 14:37:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:48 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.info Nov 02 14:37:48 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:48 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.info" returned: 0 in 0.257s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-341819b7-d267-4334-9ab8-469066374ffa tempest-CinderUnicodeTest-2106010956 None] Create snapshot completed successfully Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "cinder-b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "cinder-quobyte-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "cinder-quobyte-b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Deleting offline snapshot b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 of volume da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] snapshot_file for this snap is: volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c8d7b-3bd7-4d00-bc58-a014a44a2f3f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:49 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 Nov 02 14:37:49 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:50 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" returned: 0 in 0.386s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a979f-05f2-4bca-a78f-43ffd6d534a7]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:50 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb Nov 02 14:37:50 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:50 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" returned: 0 in 0.360s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:50 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 Nov 02 14:37:50 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:50 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" returned: 0 in 0.350s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:50 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3 Nov 02 14:37:50 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:51 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb.b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" returned: 0 in 0.277s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3" released by "_delete_snapshot" :: held 1.498s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" released by "delete_snapshot" :: held 1.522s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Created reservations ['1394dd33-5f2d-4b2c-a317-3c8ddd112170', '6d28075a-5879-46b8-a5e2-1aebd3273c8e', 'defb0dfe-2e91-454f-be48-306018f9bc1e', '1417ef37-9efb-4fd7-af93-eaee4e7af0b9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:37:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Delete snapshot completed successfully. Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a02af8de-7be7-4a10-97fa-c6a3e211f9b1 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-b3ed810a-2ec8-470d-ac04-d0e09b9f9ed3-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "cinder-da480303-7b10-4d16-ad3b-c1ca2d1b85bb-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-da480303-7b10-4d16-ad3b-c1ca2d1b85bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "cinder-quobyte-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4505fe8-4dfd-4424-9dbd-e4855e2352ee]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:52 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb Nov 02 14:37:52 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:52 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" returned: 0 in 0.373s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:52 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb Nov 02 14:37:52 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:52 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" returned: 0 in 0.267s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-da480303-7b10-4d16-ad3b-c1ca2d1b85bb" released by "delete_volume" :: held 0.712s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Created reservations ['f60b476a-4b26-4e05-8aa3-b7ba2f0553f4', '14374581-fd88-44d2-b62c-f903fb59c2c2', '42ed4b8e-24f2-49e8-9dec-223872efe296', '9a803da9-c7fd-42d9-bd8f-5e8b23e5a0ce'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:52 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:37:52 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "cinder-f130315f-4929-4a98-8196-14f379f6fc52-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:53 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-f130315f-4929-4a98-8196-14f379f6fc52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:37:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Deleted volume successfully. Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-bbd8963b-fcff-42ec-8eb4-61722b440a44 tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-da480303-7b10-4d16-ad3b-c1ca2d1b85bb-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "cinder-quobyte-f130315f-4929-4a98-8196-14f379f6fc52" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-f130315f-4929-4a98-8196-14f379f6fc52" acquired by "delete_volume" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a386a7-ce14-4c47-b545-2c2fee13b28d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:53 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 Nov 02 14:37:53 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:53 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52" returned: 0 in 0.390s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:53 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52 Nov 02 14:37:53 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:53 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f130315f-4929-4a98-8196-14f379f6fc52" returned: 0 in 0.253s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-quobyte-f130315f-4929-4a98-8196-14f379f6fc52" released by "delete_volume" :: held 0.695s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Created reservations ['bcb11a53-852f-4524-9f21-fd5b121f62ad', '336e089c-3ae3-4ecc-9b8d-f1d9bd8361f4', 'b14d7408-1b14-4bd4-9629-bce00dd11b9a', '9351dc8e-b9f4-4607-bf72-1c0fd7e92160'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:37:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:37:53 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:37:53 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:37:54 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 02 14:37:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.249s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:37:54 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:37:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Deleted volume successfully. Nov 02 14:37:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4fb91602-3b0c-4016-bf70-8ec8f59ef2ab tempest-CinderUnicodeTest-2106010956 None] Lock "cinder-f130315f-4929-4a98-8196-14f379f6fc52-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:38:03 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=34,cinder:UPDATE=35,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:38:04 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=40,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=9 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Flow 'volume_create_manager' (1e88083b-7f6f-423d-95ac-34b9f64204bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e25e32-ff23-43a1-8476-def6f6d5f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e25e32-ff23-43a1-8476-def6f6d5f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1932077234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3672db3-bf61-45e5-8fa8-823e26437a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e8645519404bd6baecdf50ca02c0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:38:15Z,use_quota=True,user_id='a2f0b8e4897448879467eed7fa1a202e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ab721-5219-456b-b931-2d4a9d6149bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2ab721-5219-456b-b931-2d4a9d6149bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf315b5-d82a-4440-9364-6583abb91be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf315b5-d82a-4440-9364-6583abb91be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3672db3-bf61-45e5-8fa8-823e26437a27', 'volume_name': 'volume-f3672db3-bf61-45e5-8fa8-823e26437a27', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ed1fc8-e93f-43a4-83be-7c3f1d0b45fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ed1fc8-e93f-43a4-83be-7c3f1d0b45fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bbf3f4-ed7d-473c-bd47-31675c50cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Volume f3672db3-bf61-45e5-8fa8-823e26437a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3672db3-bf61-45e5-8fa8-823e26437a27', 'volume_size': 1} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1932077234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3672db3-bf61-45e5-8fa8-823e26437a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e8645519404bd6baecdf50ca02c0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:38:15Z,use_quota=True,user_id='a2f0b8e4897448879467eed7fa1a202e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Creating volume f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:38:15 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:15 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 1073741824 Nov 02 14:38:15 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:15 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 1073741824" returned: 0 in 0.465s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:15 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 Nov 02 14:38:15 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:15 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27" returned: 0 in 0.260s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bbf3f4-ed7d-473c-bd47-31675c50cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3672db3-bf61-45e5-8fa8-823e26437a27', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26daded7-77aa-47d0-a63d-4020d62e8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Volume volume-f3672db3-bf61-45e5-8fa8-823e26437a27 (f3672db3-bf61-45e5-8fa8-823e26437a27): created successfully Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26daded7-77aa-47d0-a63d-4020d62e8583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Flow 'volume_create_manager' (1e88083b-7f6f-423d-95ac-34b9f64204bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:38:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-37e18473-344f-4cc6-8421-dcd4ffd4d504 tempest-TestStampPattern-1561946027 None] Created volume successfully. Nov 02 14:38:25 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:38:25 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:39 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:38:39 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:39 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.254s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:38:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:38:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-bc488d33-5535-4f60-87d4-a53a2f208125 req-a13ef4b9-04e6-47c4-aacd-72c21c294ddd tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-bc488d33-5535-4f60-87d4-a53a2f208125 req-a13ef4b9-04e6-47c4-aacd-72c21c294ddd tempest-TestStampPattern-1561946027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-bc488d33-5535-4f60-87d4-a53a2f208125 req-a13ef4b9-04e6-47c4-aacd-72c21c294ddd tempest-TestStampPattern-1561946027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:38:45 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-bc488d33-5535-4f60-87d4-a53a2f208125 req-a13ef4b9-04e6-47c4-aacd-72c21c294ddd tempest-TestStampPattern-1561946027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-f3672db3-bf61-45e5-8fa8-823e26437a27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7c97fd6-b841-4c8f-919f-b22c9335b24b', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:38:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-bc488d33-5535-4f60-87d4-a53a2f208125 req-a13ef4b9-04e6-47c4-aacd-72c21c294ddd tempest-TestStampPattern-1561946027 None] attachment_update completed successfully. Nov 02 14:38:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-e63a8499-afe0-4c56-a7cc-95a39efc5adf req-ef257fdb-daca-4a77-b871-fe6e7c0fdb0d tempest-TestStampPattern-1561946027 None] Terminate volume connection completed successfully. Nov 02 14:38:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-e63a8499-afe0-4c56-a7cc-95a39efc5adf req-ef257fdb-daca-4a77-b871-fe6e7c0fdb0d tempest-TestStampPattern-1561946027 None] Deleting attachment d7c97fd6-b841-4c8f-919f-b22c9335b24b. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:38:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Creating offline snapshot 625b44a9-ee3f-425b-adf4-6c863b8771c9 of volume f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:38:50 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f4812a-c715-49fc-9a68-20b01078ac74]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:38:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:50 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 Nov 02 14:38:50 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:50 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27" returned: 0 in 0.360s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:50 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 1G Nov 02 14:38:50 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:50 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 1G" returned: 0 in 0.416s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3672db3-bf61-45e5-8fa8-823e26437a27 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:50 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3672db3-bf61-45e5-8fa8-823e26437a27 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 Nov 02 14:38:50 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:51 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3672db3-bf61-45e5-8fa8-823e26437a27 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9" returned: 0 in 0.295s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:51 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 is being set with open permissions: ugo+rw Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:51 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 Nov 02 14:38:51 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:51 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9" returned: 0 in 0.239s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:51 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.info Nov 02 14:38:51 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:51 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.info" returned: 0 in 0.245s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:51 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.info is being set with open permissions: ugo+rw Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:51 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.info Nov 02 14:38:51 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:51 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.info" returned: 0 in 0.244s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:38:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5076a015-2bea-4a61-a9b4-c6180162fdbe tempest-TestStampPattern-1561946027 None] Create snapshot completed successfully Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Flow 'volume_create_manager' (b340e852-8330-4a81-b3c9-8abadc1273e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e08486-b025-461a-b996-0ad4debcdf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e08486-b025-461a-b996-0ad4debcdf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1431648350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e5bff6-7f0e-4871-824c-d53a21cb4dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e8645519404bd6baecdf50ca02c0cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=625b44a9-ee3f-425b-adf4-6c863b8771c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:38:59Z,use_quota=True,user_id='a2f0b8e4897448879467eed7fa1a202e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6642dabc-715e-4df1-b948-51c3f3dbd208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6642dabc-715e-4df1-b948-51c3f3dbd208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c993dc7-410e-425e-b274-bcae93bd2fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c993dc7-410e-425e-b274-bcae93bd2fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd8e5bff6-7f0e-4871-824c-d53a21cb4dd7', 'volume_name': 'volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7', 'volume_size': 1, 'snapshot_id': '625b44a9-ee3f-425b-adf4-6c863b8771c9'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956b7fdd-2066-4dd7-8503-3352dcf0308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956b7fdd-2066-4dd7-8503-3352dcf0308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66556227-c79e-4a63-ac26-dff83c2f2a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:38:58 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Volume d8e5bff6-7f0e-4871-824c-d53a21cb4dd7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7', 'volume_size': 1, 'snapshot_id': '625b44a9-ee3f-425b-adf4-6c863b8771c9'} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-quobyte-625b44a9-ee3f-425b-adf4-6c863b8771c9-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-625b44a9-ee3f-425b-adf4-6c863b8771c9-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Creating volume d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 from snapshot 625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-quobyte-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] snapshot: 625b44a9-ee3f-425b-adf4-6c863b8771c9, volume: d8e5bff6-7f0e-4871-824c-d53a21cb4dd7, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ae3c02-2e5e-4da0-ab45-8b2e3126e411]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:38:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:58 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 Nov 02 14:38:58 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:59 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3672db3-bf61-45e5-8fa8-823e26437a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6741c1-ca98-4a54-b8c0-bfb78518297a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:59 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 Nov 02 14:38:59 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:38:59 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27" returned: 0 in 0.406s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:38:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:38:59 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 Nov 02 14:38:59 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:08 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" returned: 0 in 9.034s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:08 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:39:08 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Converted 1024.00 MB image at 113.32 MB/s Nov 02 14:39:08 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 is being set with open permissions: ugo+rw Nov 02 14:39:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:08 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:39:08 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 Nov 02 14:39:08 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:08 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:39:08 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" returned: 0 in 0.290s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:08 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" released by "_copy_volume_from_snapshot" :: held 10.202s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-625b44a9-ee3f-425b-adf4-6c863b8771c9-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" released by "_create_volume_from_snapshot" :: held 10.277s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.291s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:39:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66556227-c79e-4a63-ac26-dff83c2f2a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7', 'volume_size': 1, 'snapshot_id': '625b44a9-ee3f-425b-adf4-6c863b8771c9'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:39:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e4af0f-3858-4ca0-afe0-a6de03e9c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:39:09 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Volume volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 (d8e5bff6-7f0e-4871-824c-d53a21cb4dd7): created successfully Nov 02 14:39:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e4af0f-3858-4ca0-afe0-a6de03e9c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:39:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Flow 'volume_create_manager' (b340e852-8330-4a81-b3c9-8abadc1273e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:39:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0976db12-14fb-419c-bf74-04e350e7bb91 tempest-TestStampPattern-1561946027 None] Created volume successfully. Nov 02 14:39:19 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:39:19 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:39:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-b436ec46-ac6e-453c-963c-62619e4c53c2 req-72d76922-7f4e-4637-a4d3-28883c0a0888 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:39:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-b436ec46-ac6e-453c-963c-62619e4c53c2 req-72d76922-7f4e-4637-a4d3-28883c0a0888 tempest-TestStampPattern-1561946027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:39:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [req-b436ec46-ac6e-453c-963c-62619e4c53c2 req-72d76922-7f4e-4637-a4d3-28883c0a0888 tempest-TestStampPattern-1561946027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:39:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-b436ec46-ac6e-453c-963c-62619e4c53c2 req-72d76922-7f4e-4637-a4d3-28883c0a0888 tempest-TestStampPattern-1561946027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86', 'name': 'volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47d9faab-4feb-4c6e-987a-cf9bcd1d21c4', 'enforce_multipath': True} {{(pid=86978) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 14:39:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-b436ec46-ac6e-453c-963c-62619e4c53c2 req-72d76922-7f4e-4637-a4d3-28883c0a0888 tempest-TestStampPattern-1561946027 None] attachment_update completed successfully. Nov 02 14:39:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [req-aab7d8a6-24e7-44ef-9c51-b46579653cf9 req-d762cdbb-2078-4a4e-a156-ffa8a2da8958 tempest-TestStampPattern-1561946027 None] Terminate volume connection completed successfully. Nov 02 14:39:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [req-aab7d8a6-24e7-44ef-9c51-b46579653cf9 req-d762cdbb-2078-4a4e-a156-ffa8a2da8958 tempest-TestStampPattern-1561946027 None] Deleting attachment 47d9faab-4feb-4c6e-987a-cf9bcd1d21c4. {{(pid=86978) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:39 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:39:39 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:39 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:39:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:39:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:39:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Lock "cinder-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:39:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-quobyte-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:39:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:39:41 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[935ed9da-f26c-4ab6-ab49-fccfc34cc3ed]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:39:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:41 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 Nov 02 14:39:41 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:42 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" returned: 0 in 0.360s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:42 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7 Nov 02 14:39:42 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:42 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" returned: 0 in 0.247s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7" released by "delete_volume" :: held 0.650s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Created reservations ['4d431b40-fe47-40d4-83c2-d594839cab6c', '473c92f2-54c9-433b-8923-683d20e82725', 'fec95915-3ac1-412e-b49d-e5c818df882b', '67f6c1aa-df92-4601-ae90-1b23fda349e8'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:42 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:39:42 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:42 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.243s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:39:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Deleted volume successfully. Nov 02 14:39:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c600c85e-91b8-4d21-bb33-2fd6743ca5a2 tempest-TestStampPattern-1561946027 None] Lock "cinder-d8e5bff6-7f0e-4871-824c-d53a21cb4dd7-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-625b44a9-ee3f-425b-adf4-6c863b8771c9-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Lock "cinder-625b44a9-ee3f-425b-adf4-6c863b8771c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-quobyte-f3672db3-bf61-45e5-8fa8-823e26437a27" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-f3672db3-bf61-45e5-8fa8-823e26437a27" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-quobyte-625b44a9-ee3f-425b-adf4-6c863b8771c9" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-625b44a9-ee3f-425b-adf4-6c863b8771c9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Deleting offline snapshot 625b44a9-ee3f-425b-adf4-6c863b8771c9 of volume f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] snapshot_file for this snap is: volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d924e12b-01fb-4097-91f7-c389c969eb14]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:43 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 Nov 02 14:39:43 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:43 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9" returned: 0 in 0.360s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3672db3-bf61-45e5-8fa8-823e26437a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd49228-b2ae-43ed-952a-67d8a237c090]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:39:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:43 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 Nov 02 14:39:43 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:44 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27" returned: 0 in 0.518s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:44 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 Nov 02 14:39:44 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:44 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9" returned: 0 in 0.328s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:44 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9 Nov 02 14:39:44 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:44 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27.625b44a9-ee3f-425b-adf4-6c863b8771c9" returned: 0 in 0.250s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-625b44a9-ee3f-425b-adf4-6c863b8771c9" released by "_delete_snapshot" :: held 1.555s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-f3672db3-bf61-45e5-8fa8-823e26437a27" released by "delete_snapshot" :: held 1.578s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Created reservations ['5ab058c4-3472-4145-8004-40c52234b604', '3b46d5e5-abb1-44e5-ae0b-4503849aadf4', 'fd22fb5c-ff78-4f0d-93b0-c3a30bc9bb46', '6d2c29ed-d640-4938-8bc1-fdd26c88f818'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:39:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Delete snapshot completed successfully. Nov 02 14:39:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ed8129dd-9c43-4bd9-87a8-da6ee4295bc3 tempest-TestStampPattern-1561946027 None] Lock "cinder-625b44a9-ee3f-425b-adf4-6c863b8771c9-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-f3672db3-bf61-45e5-8fa8-823e26437a27-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:39:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Lock "cinder-f3672db3-bf61-45e5-8fa8-823e26437a27-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:39:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Acquiring lock "cinder-quobyte-f3672db3-bf61-45e5-8fa8-823e26437a27" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:39:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-f3672db3-bf61-45e5-8fa8-823e26437a27" acquired by "delete_volume" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:39:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[451b1a00-95e5-4ae2-a5fe-a876874d4997]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:39:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:48 devstack sudo[103815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 Nov 02 14:39:48 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:49 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27" returned: 0 in 0.355s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:49 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27 Nov 02 14:39:49 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:49 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f3672db3-bf61-45e5-8fa8-823e26437a27" returned: 0 in 0.246s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Lock "cinder-quobyte-f3672db3-bf61-45e5-8fa8-823e26437a27" released by "delete_volume" :: held 0.664s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Created reservations ['0ecc5c8e-1a73-4a80-a28f-d026259e3caa', 'f6317062-d105-4104-8d74-137be6aea2e2', '70e852e4-e883-4b4e-9f0a-f299928b6bdf', 'c96a3dad-84af-4a16-889a-ecfd4fc5945e'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:39:49 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:39:49 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:39:49 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.249s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:39:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Deleted volume successfully. Nov 02 14:39:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-e15a1753-5de6-4a70-ba07-40591d5c9c34 tempest-TestStampPattern-1561946027 None] Lock "cinder-f3672db3-bf61-45e5-8fa8-823e26437a27-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:39:59 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=24,cinder:INSERT=6,cinder:UPDATE=23 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:39:59 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=23,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Flow 'volume_create_manager' (9ccaa152-82d5-4703-8b0b-5008a91c7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff02461-9f8d-40c3-8bc7-9a134123006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff02461-9f8d-40c3-8bc7-9a134123006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e798dc1b4789b29f3299e75a5888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:05Z,use_quota=True,user_id='536f0ebedc27466a8bbbbf3d444a9e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f8bf8d-0ca0-4943-bf4c-eaf287d16266),volume_type_id=a8f8bf8d-0ca0-4943-bf4c-eaf287d16266)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e8d145-4f4a-4f4a-b0de-6f828fc20971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e8d145-4f4a-4f4a-b0de-6f828fc20971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12ee7af-1cd1-46bb-a81e-ffab131c5b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:04 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12ee7af-1cd1-46bb-a81e-ffab131c5b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7', 'volume_name': 'volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7', 'volume_size': 1, 'image_id': '36f3d44f-2ae1-4528-9826-5de4d340de3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36f3d44f-2ae1-4528-9826-5de4d340de3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbd72d50cf9668434a7dde5494cb137e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd516e798dc1b4789b29f3299e75a5888', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ee9c979126ca1b487d4ec34bc0e7b3e5e00e7e8b1963fe8b0d38d6372cda899dc4f26387a63ac466a13c1fa1de5f400478e040f6eeaced294cc7ea0315aa164', 'id': '36f3d44f-2ae1-4528-9826-5de4d340de3e', 'created_at': datetime.datetime(2026, 11, 2, 13, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 40, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36f3d44f-2ae1-4528-9826-5de4d340de3e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056e8ee1-6ca6-4314-bc2b-f6de0036a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056e8ee1-6ca6-4314-bc2b-f6de0036a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734cf4d-a68c-4993-a2a0-cfe9e79f0573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:05 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Volume 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7', 'volume_size': 1, 'image_id': '36f3d44f-2ae1-4528-9826-5de4d340de3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36f3d44f-2ae1-4528-9826-5de4d340de3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbd72d50cf9668434a7dde5494cb137e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd516e798dc1b4789b29f3299e75a5888', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ee9c979126ca1b487d4ec34bc0e7b3e5e00e7e8b1963fe8b0d38d6372cda899dc4f26387a63ac466a13c1fa1de5f400478e040f6eeaced294cc7ea0315aa164', 'id': '36f3d44f-2ae1-4528-9826-5de4d340de3e', 'created_at': datetime.datetime(2026, 11, 2, 13, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 40, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36f3d44f-2ae1-4528-9826-5de4d340de3e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Trying to clone 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 from image 36f3d44f-2ae1-4528-9826-5de4d340de3e at location (None, [{'url': 'file:///opt/stack/data/glance/images/36f3d44f-2ae1-4528-9826-5de4d340de3e', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:40:05 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Image download 0.00 MB at 0.00 MB/s Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c89cf7-3a72-498c-972d-f8b3a616518a]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:05 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD Nov 02 14:40:05 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:05 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:05 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD Nov 02 14:40:05 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:05 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Temporary image 36f3d44f-2ae1-4528-9826-5de4d340de3e is fetched for user 536f0ebedc27466a8bbbbf3d444a9e01. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f276dc-d065-44be-b9ff-b94370a2eafc]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:06 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD Nov 02 14:40:06 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:06 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:06 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD Nov 02 14:40:06 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:06 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d516e798dc1b4789b29f3299e75a5888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:05Z,use_quota=True,user_id='536f0ebedc27466a8bbbbf3d444a9e01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8f8bf8d-0ca0-4943-bf4c-eaf287d16266),volume_type_id=a8f8bf8d-0ca0-4943-bf4c-eaf287d16266)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Creating volume 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:06 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:06 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 1073741824 Nov 02 14:40:06 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:06 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 1073741824" returned: 0 in 0.417s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:07 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 Nov 02 14:40:07 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:07 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7" returned: 0 in 0.240s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Attempting download of 36f3d44f-2ae1-4528-9826-5de4d340de3e ((None, [{'url': 'file:///opt/stack/data/glance/images/36f3d44f-2ae1-4528-9826-5de4d340de3e', 'metadata': {}}])) to volume 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e94bc-25c9-4bff-a4a0-bc475cd3f738]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36f3d44f-2ae1-4528-9826-5de4d340de3e_c4gcif7s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:07 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36f3d44f-2ae1-4528-9826-5de4d340de3e_c4gcif7s Nov 02 14:40:07 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:07 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36f3d44f-2ae1-4528-9826-5de4d340de3e_c4gcif7s" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36f3d44f-2ae1-4528-9826-5de4d340de3e_c4gcif7s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:07 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36f3d44f-2ae1-4528-9826-5de4d340de3e_c4gcif7s Nov 02 14:40:07 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:07 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36f3d44f-2ae1-4528-9826-5de4d340de3e_c4gcif7s" returned: 1 in 0.320s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36f3d44f-2ae1-4528-9826-5de4d340de3e_c4gcif7s' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b853daf7-b7dc-453c-9c59-0f13e0bc657d]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:08 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD Nov 02 14:40:08 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:08 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:08 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD Nov 02 14:40:08 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:08 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:08 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] 36f3d44f-2ae1-4528-9826-5de4d340de3e was raw, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:40:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:08 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 Nov 02 14:40:08 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:09 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7" returned: 0 in 0.442s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36f3d44f-2ae1-4528-9826-5de4d340de3e_u7xa2y1ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:40:09 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:09 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 1G Nov 02 14:40:09 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:09 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 1G" returned: 0 in 0.307s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Downloaded image 36f3d44f-2ae1-4528-9826-5de4d340de3e ((None, [{'url': 'file:///opt/stack/data/glance/images/36f3d44f-2ae1-4528-9826-5de4d340de3e', 'metadata': {}}])) to volume 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Temporary image 36f3d44f-2ae1-4528-9826-5de4d340de3e for user 536f0ebedc27466a8bbbbf3d444a9e01 is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Marking volume 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Copying metadata from image 36f3d44f-2ae1-4528-9826-5de4d340de3e to 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Creating volume glance metadata for volume 4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 backed by image 36f3d44f-2ae1-4528-9826-5de4d340de3e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '36f3d44f-2ae1-4528-9826-5de4d340de3e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bbd72d50cf9668434a7dde5494cb137e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734cf4d-a68c-4993-a2a0-cfe9e79f0573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7', 'volume_size': 1, 'image_id': '36f3d44f-2ae1-4528-9826-5de4d340de3e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36f3d44f-2ae1-4528-9826-5de4d340de3e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbd72d50cf9668434a7dde5494cb137e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd516e798dc1b4789b29f3299e75a5888', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ee9c979126ca1b487d4ec34bc0e7b3e5e00e7e8b1963fe8b0d38d6372cda899dc4f26387a63ac466a13c1fa1de5f400478e040f6eeaced294cc7ea0315aa164', 'id': '36f3d44f-2ae1-4528-9826-5de4d340de3e', 'created_at': datetime.datetime(2026, 11, 2, 13, 40, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 40, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36f3d44f-2ae1-4528-9826-5de4d340de3e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f647af72-02a9-4cd3-aa0e-e2b285cee1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:09 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Volume volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 (4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7): created successfully Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f647af72-02a9-4cd3-aa0e-e2b285cee1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:09 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Flow 'volume_create_manager' (9ccaa152-82d5-4703-8b0b-5008a91c7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:09 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-30d7ec8e-1b97-4028-a151-028b02fb2b96 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Created volume successfully. Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Acquiring lock "cinder-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "cinder-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Acquiring lock "cinder-quobyte-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "cinder-quobyte-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7" acquired by "delete_volume" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2630bd5f-da8d-422a-b476-33bfcea15f58]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:10 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 Nov 02 14:40:10 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:10 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7" returned: 0 in 0.371s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:10 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7 Nov 02 14:40:10 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:10 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7" returned: 0 in 0.247s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "cinder-quobyte-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7" released by "delete_volume" :: held 0.662s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:10 devstack cinder-volume[86978]: WARNING cinder.quota [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:40:10 devstack cinder-volume[86978]: WARNING cinder.quota [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Created reservations ['3dc68e8e-9ece-4c3f-a89b-050fb11b400b', 'f2cdd29d-3097-46db-ac3a-09e4a7a45040', '4bad3f97-b548-47ba-b81d-9772a6990578', '1eeb7f90-347d-48b8-b012-7fd35e228853'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:10 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:10 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:11 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.247s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:11 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:11 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Deleted volume successfully. Nov 02 14:40:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b60a0768-7f4f-492b-83e9-ca98a0428617 tempest-VolumeAndVolumeTypeFromImageTest-244324452 None] Lock "cinder-4fbdf72c-3e80-4118-8b1f-2e4010b9fcc7-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Flow 'volume_create_manager' (12343c3c-25d9-47de-a2fe-c3eeb91c3ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322db8c0-88ec-4e2b-bf79-9b0e5cf014a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322db8c0-88ec-4e2b-bf79-9b0e5cf014a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734652085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478e7610-d75e-4761-9707-36f1201ca71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c70e30ca4544891a12aa21e01c48922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:16Z,use_quota=True,user_id='7a9b35b43d914ac8b7935e7af4a7cb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76838b0-fa89-406f-b8c2-5eeee72306cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76838b0-fa89-406f-b8c2-5eeee72306cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aefb782-c406-4250-ab09-b1de5cd435fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aefb782-c406-4250-ab09-b1de5cd435fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478e7610-d75e-4761-9707-36f1201ca71b', 'volume_name': 'volume-478e7610-d75e-4761-9707-36f1201ca71b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fcffc44-8c67-4d82-a142-5c357b5456fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fcffc44-8c67-4d82-a142-5c357b5456fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6826e2-2eaf-4c2a-99cc-ae9773b212d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Volume 478e7610-d75e-4761-9707-36f1201ca71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478e7610-d75e-4761-9707-36f1201ca71b', 'volume_size': 1} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734652085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478e7610-d75e-4761-9707-36f1201ca71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c70e30ca4544891a12aa21e01c48922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:16Z,use_quota=True,user_id='7a9b35b43d914ac8b7935e7af4a7cb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Creating volume 478e7610-d75e-4761-9707-36f1201ca71b {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:15 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:15 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b 1073741824 Nov 02 14:40:15 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:16 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b 1073741824" returned: 0 in 0.411s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:16 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b Nov 02 14:40:16 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:16 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b" returned: 0 in 0.250s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6826e2-2eaf-4c2a-99cc-ae9773b212d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478e7610-d75e-4761-9707-36f1201ca71b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d3c502-bbeb-470b-9f03-1a8c695d4cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:16 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Volume volume-478e7610-d75e-4761-9707-36f1201ca71b (478e7610-d75e-4761-9707-36f1201ca71b): created successfully Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d3c502-bbeb-470b-9f03-1a8c695d4cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Flow 'volume_create_manager' (12343c3c-25d9-47de-a2fe-c3eeb91c3ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9daa1572-7d62-40b5-97cd-f49a9a7e65c6 tempest-ProjectReaderTests-392507593 None] Created volume successfully. Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Acquiring lock "cinder-478e7610-d75e-4761-9707-36f1201ca71b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Lock "cinder-478e7610-d75e-4761-9707-36f1201ca71b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Acquiring lock "cinder-quobyte-478e7610-d75e-4761-9707-36f1201ca71b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Lock "cinder-quobyte-478e7610-d75e-4761-9707-36f1201ca71b" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[02701a3b-c72a-42d7-ad78-e68b948db87e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:17 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b Nov 02 14:40:17 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:17 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b" returned: 0 in 0.366s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:17 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b Nov 02 14:40:17 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:17 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-478e7610-d75e-4761-9707-36f1201ca71b" returned: 0 in 0.243s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Lock "cinder-quobyte-478e7610-d75e-4761-9707-36f1201ca71b" released by "delete_volume" :: held 0.656s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Created reservations ['89d9dfbd-c8a0-4ec1-8025-9556c117cf41', '40f7030c-1e94-4a44-a7af-92de386df21d', '352540bc-4c91-4cb7-a5d4-5adc95a57394', '09a21954-62ee-4558-9a03-d0b6439c8dca'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:17 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:17 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:18 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.242s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Deleted volume successfully. Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6d9c0901-82c2-42ae-b66e-746a578b9d8e tempest-ProjectReaderTests-392507593 None] Lock "cinder-478e7610-d75e-4761-9707-36f1201ca71b-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Flow 'volume_create_manager' (d66d545e-aea8-43a6-a553-34c7e2afbb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149f463f-2f3d-4de0-ad84-7228d5c69be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149f463f-2f3d-4de0-ad84-7228d5c69be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423667901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4533c3-418a-404c-bb54-831f908b0dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c70e30ca4544891a12aa21e01c48922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:18Z,use_quota=True,user_id='7a9b35b43d914ac8b7935e7af4a7cb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbf6cda-8ec5-44f5-8ed9-82ac5b090d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbf6cda-8ec5-44f5-8ed9-82ac5b090d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12442238-e5d0-4a87-87c9-5bdcc32b3449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12442238-e5d0-4a87-87c9-5bdcc32b3449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4533c3-418a-404c-bb54-831f908b0dc5', 'volume_name': 'volume-3c4533c3-418a-404c-bb54-831f908b0dc5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c24561-f2c1-47d0-ac1a-6189a13905c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c24561-f2c1-47d0-ac1a-6189a13905c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7075590-cbf1-440c-b682-6aae2e27a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Volume 3c4533c3-418a-404c-bb54-831f908b0dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4533c3-418a-404c-bb54-831f908b0dc5', 'volume_size': 1} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423667901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4533c3-418a-404c-bb54-831f908b0dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c70e30ca4544891a12aa21e01c48922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:18Z,use_quota=True,user_id='7a9b35b43d914ac8b7935e7af4a7cb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Creating volume 3c4533c3-418a-404c-bb54-831f908b0dc5 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:18 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:18 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 1073741824 Nov 02 14:40:18 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:19 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 1073741824" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:19 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 Nov 02 14:40:19 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:19 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7075590-cbf1-440c-b682-6aae2e27a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4533c3-418a-404c-bb54-831f908b0dc5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7cc57-d6a1-4ed0-b52e-3d90c5bb5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Volume volume-3c4533c3-418a-404c-bb54-831f908b0dc5 (3c4533c3-418a-404c-bb54-831f908b0dc5): created successfully Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7cc57-d6a1-4ed0-b52e-3d90c5bb5e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Flow 'volume_create_manager' (d66d545e-aea8-43a6-a553-34c7e2afbb3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a65c44c2-c5cc-456d-b343-23c5bf27f076 tempest-ProjectReaderTests-392507593 None] Created volume successfully. Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Acquiring lock "cinder-3c4533c3-418a-404c-bb54-831f908b0dc5-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Lock "cinder-3c4533c3-418a-404c-bb54-831f908b0dc5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Acquiring lock "cinder-quobyte-3c4533c3-418a-404c-bb54-831f908b0dc5" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Lock "cinder-quobyte-3c4533c3-418a-404c-bb54-831f908b0dc5" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c537d505-c6de-4b25-83cb-693ea9be2d5c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:19 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 Nov 02 14:40:19 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:20 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5" returned: 0 in 0.361s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:20 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5 Nov 02 14:40:20 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:20 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3c4533c3-418a-404c-bb54-831f908b0dc5" returned: 0 in 0.245s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Lock "cinder-quobyte-3c4533c3-418a-404c-bb54-831f908b0dc5" released by "delete_volume" :: held 0.648s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Created reservations ['a2cdac47-104d-4063-ae26-fe9f5a3d65aa', '6740b670-62f8-47b8-9f2b-dca4b6fe9c78', '1f0a0878-d438-46f7-a09e-b866056f4e05', 'd7e660f0-f486-4599-b488-567d4a5bb065'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:20 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:20 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:20 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.248s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:20 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Deleted volume successfully. Nov 02 14:40:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d58f76bc-abdb-4bdf-9b47-6129706ab358 tempest-ProjectReaderTests-392507593 None] Lock "cinder-3c4533c3-418a-404c-bb54-831f908b0dc5-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:30 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=33,cinder:SELECT=28,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:40:30 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=26,cinder:INSERT=14,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (04ca4b46-be53-4e28-86f1-f63bf48f2203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1977a7e8-c3e9-4b8a-bae6-911c5a52062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1977a7e8-c3e9-4b8a-bae6-911c5a52062b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493940527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec706cc-ad2c-4835-8a3e-4e21ef0c376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:33Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135e6676-4d19-4049-aa23-066a38ae133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135e6676-4d19-4049-aa23-066a38ae133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd3cae8-d00b-4242-9e87-2baeb82affa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd3cae8-d00b-4242-9e87-2baeb82affa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec706cc-ad2c-4835-8a3e-4e21ef0c376f', 'volume_name': 'volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c199c416-6655-48d6-8ea0-2a93d84e9eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c199c416-6655-48d6-8ea0-2a93d84e9eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e80cf79-20bc-44ad-82d3-757f9a6aecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:32 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Volume 8ec706cc-ad2c-4835-8a3e-4e21ef0c376f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f', 'volume_size': 1} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493940527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec706cc-ad2c-4835-8a3e-4e21ef0c376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:33Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Creating volume 8ec706cc-ad2c-4835-8a3e-4e21ef0c376f {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:32 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:32 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f 1073741824 Nov 02 14:40:32 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (7e083929-19be-4855-9ae4-0da20d9885a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b550d-e68c-416a-9494-95f3219eb7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b550d-e68c-416a-9494-95f3219eb7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75551146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67015670-4fe7-4c09-9ab5-b2fe46a70899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:33Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f42126e-cfe8-4b34-8dd2-bee5b52a3015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f42126e-cfe8-4b34-8dd2-bee5b52a3015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525dcc89-16f0-4ca0-9b86-3a9b056a4542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525dcc89-16f0-4ca0-9b86-3a9b056a4542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67015670-4fe7-4c09-9ab5-b2fe46a70899', 'volume_name': 'volume-67015670-4fe7-4c09-9ab5-b2fe46a70899', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a4bf8d-2630-4ab0-830f-b5696c40dd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a4bf8d-2630-4ab0-830f-b5696c40dd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b17d22-458f-42af-81ff-5fe5bc46e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume 67015670-4fe7-4c09-9ab5-b2fe46a70899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67015670-4fe7-4c09-9ab5-b2fe46a70899', 'volume_size': 1} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (4398da59-a245-4fdc-a49d-96056f35d751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53421b64-bed8-4c7d-acda-c61183762308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53421b64-bed8-4c7d-acda-c61183762308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4899409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35cc0ea-b1a7-4fee-ad3c-16027f42c02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:33Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07e8248-7fca-4fef-9b53-97b647212e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07e8248-7fca-4fef-9b53-97b647212e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cc2c1e-b352-472b-9a14-1d86da55f06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cc2c1e-b352-472b-9a14-1d86da55f06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35cc0ea-b1a7-4fee-ad3c-16027f42c02b', 'volume_name': 'volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff2e2a2-cd35-4a35-9b4e-7058584382c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff2e2a2-cd35-4a35-9b4e-7058584382c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23986de-c1ad-485b-bff6-3d5585517883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Volume c35cc0ea-b1a7-4fee-ad3c-16027f42c02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b', 'volume_size': 1} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f 1073741824" returned: 0 in 0.670s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:33 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f Nov 02 14:40:33 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (6a7a3746-dc8d-4b54-8188-fe8d8440838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6b591b-362d-4deb-a6af-70e2bd8affa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6b591b-362d-4deb-a6af-70e2bd8affa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642952995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2f126e-a314-4305-821a-1dc509887f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:34Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d17fa4-e153-45ff-84c5-fc2497e2a33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d17fa4-e153-45ff-84c5-fc2497e2a33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65276866-c4dd-4eb4-96ec-58b373b2a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65276866-c4dd-4eb4-96ec-58b373b2a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2f126e-a314-4305-821a-1dc509887f7e', 'volume_name': 'volume-7a2f126e-a314-4305-821a-1dc509887f7e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760fecb3-5396-4f22-a9d5-d1b421271756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760fecb3-5396-4f22-a9d5-d1b421271756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99913dd-c386-4d4b-b0cc-db27a924036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:33 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume 7a2f126e-a314-4305-821a-1dc509887f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2f126e-a314-4305-821a-1dc509887f7e', 'volume_size': 1} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:33 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:33 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (75394902-e636-4ac7-a381-860562175678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2f2b63-4522-4e54-935b-81ab729cebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f" returned: 0 in 0.386s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-75551146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67015670-4fe7-4c09-9ab5-b2fe46a70899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:33Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Creating volume 67015670-4fe7-4c09-9ab5-b2fe46a70899 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:34 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2f2b63-4522-4e54-935b-81ab729cebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1060377466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d9fb67-a2c3-411d-b69f-50891232bd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:34Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8426364-1573-42de-ab53-9564d8d79265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 1073741824 Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8426364-1573-42de-ab53-9564d8d79265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c317bc8-e3ae-4bde-aa77-157f5e2248a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c317bc8-e3ae-4bde-aa77-157f5e2248a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d9fb67-a2c3-411d-b69f-50891232bd97', 'volume_name': 'volume-e7d9fb67-a2c3-411d-b69f-50891232bd97', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3a886e-9dd3-4689-81ed-401f25575744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3a886e-9dd3-4689-81ed-401f25575744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42bb54b-2007-49ac-8a69-c6f681c08717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Volume e7d9fb67-a2c3-411d-b69f-50891232bd97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d9fb67-a2c3-411d-b69f-50891232bd97', 'volume_size': 1} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e80cf79-20bc-44ad-82d3-757f9a6aecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba49c2f-b4b5-41b0-92c8-dad97565f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Volume volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f (8ec706cc-ad2c-4835-8a3e-4e21ef0c376f): created successfully Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba49c2f-b4b5-41b0-92c8-dad97565f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (04ca4b46-be53-4e28-86f1-f63bf48f2203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3b33c6e0-3856-4d8a-b1d9-1ac02868ee68 tempest-CreateVolumesFromImageTest-1773206675 None] Created volume successfully. Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (1651ac5f-4e47-4694-a788-0aa0cf0fdf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a338d59c-8a64-4428-a962-318ec723577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a338d59c-8a64-4428-a962-318ec723577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059871794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549e7f1d-525c-4438-9399-f5e5253b5380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:34Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878c2291-5506-4dea-b554-8da916b66a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878c2291-5506-4dea-b554-8da916b66a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e44e7b-081b-4151-be7c-94322f9acadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e44e7b-081b-4151-be7c-94322f9acadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549e7f1d-525c-4438-9399-f5e5253b5380', 'volume_name': 'volume-549e7f1d-525c-4438-9399-f5e5253b5380', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcb9156-8640-4f0b-b037-3cc3fd91b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcb9156-8640-4f0b-b037-3cc3fd91b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a603b1b-1ef2-498b-aaef-6ff99088058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Volume 549e7f1d-525c-4438-9399-f5e5253b5380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549e7f1d-525c-4438-9399-f5e5253b5380', 'volume_size': 1} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:34 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 1073741824" returned: 0 in 0.638s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:34 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 Nov 02 14:40:34 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (a96b2531-00a0-478e-855d-758e77564ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4f1cb-32d7-49f3-a61d-e38d6ec36dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b4f1cb-32d7-49f3-a61d-e38d6ec36dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-773396788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ecee7-25cf-491e-9983-87d51439b1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:35Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6095e1-19c1-4996-bce1-5cc68312560f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6095e1-19c1-4996-bce1-5cc68312560f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a2b1ea-5301-48d1-9bd4-1e59390a1f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a2b1ea-5301-48d1-9bd4-1e59390a1f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730ecee7-25cf-491e-9983-87d51439b1da', 'volume_name': 'volume-730ecee7-25cf-491e-9983-87d51439b1da', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa98701-2046-4cb0-bfc3-63cec35be6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa98701-2046-4cb0-bfc3-63cec35be6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae386cbf-fb12-45ac-9184-312bf6fa0a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:34 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Volume 730ecee7-25cf-491e-9983-87d51439b1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730ecee7-25cf-491e-9983-87d51439b1da', 'volume_size': 1} Nov 02 14:40:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:35 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4899409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35cc0ea-b1a7-4fee-ad3c-16027f42c02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:33Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Creating volume c35cc0ea-b1a7-4fee-ad3c-16027f42c02b {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:35 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b17d22-458f-42af-81ff-5fe5bc46e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67015670-4fe7-4c09-9ab5-b2fe46a70899', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637cbef-081d-40be-aa25-881a12e57027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:35 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b 1073741824 Nov 02 14:40:35 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 (67015670-4fe7-4c09-9ab5-b2fe46a70899): created successfully Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637cbef-081d-40be-aa25-881a12e57027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (7e083929-19be-4855-9ae4-0da20d9885a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-235efd6f-910e-4cce-bd58-4dcc1a33b149 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created volume successfully. Nov 02 14:40:35 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b 1073741824" returned: 0 in 0.523s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:35 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b Nov 02 14:40:35 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:35 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b" returned: 0 in 0.299s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.057s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1642952995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2f126e-a314-4305-821a-1dc509887f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:34Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Creating volume 7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:35 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23986de-c1ad-485b-bff6-3d5585517883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108eb7af-db1d-43e2-835e-384add1dd29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:35 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e 1073741824 Nov 02 14:40:35 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Volume volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b (c35cc0ea-b1a7-4fee-ad3c-16027f42c02b): created successfully Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108eb7af-db1d-43e2-835e-384add1dd29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (4398da59-a245-4fdc-a49d-96056f35d751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:36 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-78ea3ca4-22f3-49c1-8999-7702e9c47580 tempest-CreateVolumesFromImageTest-1773206675 None] Created volume successfully. Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (7fd1bddb-b73d-490f-8eff-fbfac6657081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026ad093-199b-4c4e-8c27-82b71a70e518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026ad093-199b-4c4e-8c27-82b71a70e518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730305930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b0460a-bcee-45f8-91b0-1af8f82acbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:36Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df297a9-730a-488e-841a-1f2d800cee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df297a9-730a-488e-841a-1f2d800cee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936a97ca-a79a-48bc-8219-44cbe12ec01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936a97ca-a79a-48bc-8219-44cbe12ec01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b0460a-bcee-45f8-91b0-1af8f82acbfa', 'volume_name': 'volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada4d34-bdc3-46cc-a181-6bb220e08729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bada4d34-bdc3-46cc-a181-6bb220e08729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47391249-989f-4138-aeab-abc71aacf3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume 77b0460a-bcee-45f8-91b0-1af8f82acbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa', 'volume_size': 1} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (5b7437f3-a3e7-4e11-87a6-73d40a80a3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9aca777-9c1b-43f1-81cc-5cbb7fe61caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9aca777-9c1b-43f1-81cc-5cbb7fe61caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1099060695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e146da-9f6b-4357-a4b0-e97b86501800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:36Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b6332-c06d-4568-879f-3c39bf2680e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68b6332-c06d-4568-879f-3c39bf2680e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476bb794-e48c-4e2e-aa82-22de013b0788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476bb794-e48c-4e2e-aa82-22de013b0788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e146da-9f6b-4357-a4b0-e97b86501800', 'volume_name': 'volume-92e146da-9f6b-4357-a4b0-e97b86501800', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95661f07-d900-4fa7-b780-7729921a8859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95661f07-d900-4fa7-b780-7729921a8859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16b27a2-ceb0-4d26-8cf6-99fd2d870e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume 92e146da-9f6b-4357-a4b0-e97b86501800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e146da-9f6b-4357-a4b0-e97b86501800', 'volume_size': 1} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:36 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e 1073741824" returned: 0 in 0.638s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:36 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e Nov 02 14:40:36 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (4c137f09-e493-4ea7-a77d-952ce924c9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121ed56b-75ca-42cc-b25e-7733692a0c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121ed56b-75ca-42cc-b25e-7733692a0c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1735413113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57dd7fc-d20c-4045-8c3a-e3a59d17457e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:37Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f1613c-79ea-4f61-b535-bd0cd5586a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f1613c-79ea-4f61-b535-bd0cd5586a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb067f39-7331-4559-9d2b-c3bf08ad49eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb067f39-7331-4559-9d2b-c3bf08ad49eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a57dd7fc-d20c-4045-8c3a-e3a59d17457e', 'volume_name': 'volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61a5627-163d-4209-b59b-50eb35e8b5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61a5627-163d-4209-b59b-50eb35e8b5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc8765e-0589-4d79-bbe1-0d4d5fbb3215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume a57dd7fc-d20c-4045-8c3a-e3a59d17457e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e', 'volume_size': 1} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.878s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1060377466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d9fb67-a2c3-411d-b69f-50891232bd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:34Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Creating volume e7d9fb67-a2c3-411d-b69f-50891232bd97 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:37 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:37 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 1073741824 Nov 02 14:40:37 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99913dd-c386-4d4b-b0cc-db27a924036a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2f126e-a314-4305-821a-1dc509887f7e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d594b980-4d29-497d-a101-ec3429be79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume volume-7a2f126e-a314-4305-821a-1dc509887f7e (7a2f126e-a314-4305-821a-1dc509887f7e): created successfully Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d594b980-4d29-497d-a101-ec3429be79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (6a7a3746-dc8d-4b54-8188-fe8d8440838f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-71bcb73a-bae8-41ff-8849-bf8968f321f2 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created volume successfully. Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (2212da23-0ff9-4953-bf5e-d1654f4dfd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60d428a-2520-4189-a693-a71524878212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60d428a-2520-4189-a693-a71524878212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1735162347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04180285-b04f-4de6-a5c7-63b436d26c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:37Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956af67a-457e-466b-8090-6f7ae14e8bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956af67a-457e-466b-8090-6f7ae14e8bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96003e05-b9bc-4df9-9ae3-62c5cd65d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96003e05-b9bc-4df9-9ae3-62c5cd65d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04180285-b04f-4de6-a5c7-63b436d26c45', 'volume_name': 'volume-04180285-b04f-4de6-a5c7-63b436d26c45', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd24b867-bc89-480e-b39a-d1831d5aa47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd24b867-bc89-480e-b39a-d1831d5aa47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775cfade-3bcc-49e5-8021-e6db912b02b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume 04180285-b04f-4de6-a5c7-63b436d26c45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04180285-b04f-4de6-a5c7-63b436d26c45', 'volume_size': 1} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:37 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 1073741824" returned: 0 in 0.628s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:37 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 Nov 02 14:40:37 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Flow 'volume_create_manager' (33ad09bc-e9da-498b-ad75-19c76bfa0843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a891234-7621-42ba-987c-3e4515f7a5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a891234-7621-42ba-987c-3e4515f7a5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a1e96-73a6-43d9-a104-a3828cf397b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa3ffa7c14f43bea368ac78c3f563cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:38Z,use_quota=True,user_id='d90fb239cc0b4a44b434ae782b50491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0be13e4-df35-4412-bee2-c996db50d198),volume_type_id=a0be13e4-df35-4412-bee2-c996db50d198)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdd5353-477c-4594-a1cf-e177d3af6311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbdd5353-477c-4594-a1cf-e177d3af6311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6128e-d060-47dd-8b85-7fce8480d1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (54167f6c-8aa7-48d7-885a-c891324533ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95339c24-be8d-42f9-9fba-6aa875a4ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95339c24-be8d-42f9-9fba-6aa875a4ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961149331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1854900d-2a98-41ea-a876-c8402d12ea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:38Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494e5552-52b9-46f2-a769-3884c3bf1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494e5552-52b9-46f2-a769-3884c3bf1b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58143922-59b9-45a0-91f6-29322224cfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58143922-59b9-45a0-91f6-29322224cfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1854900d-2a98-41ea-a876-c8402d12ea56', 'volume_name': 'volume-1854900d-2a98-41ea-a876-c8402d12ea56', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8493b85-a7f2-495f-ac1f-6f426f8258ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8493b85-a7f2-495f-ac1f-6f426f8258ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d859f8ed-0b9d-444b-b3c6-7a5ce1313b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:37 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume 1854900d-2a98-41ea-a876-c8402d12ea56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1854900d-2a98-41ea-a876-c8402d12ea56', 'volume_size': 1} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97" returned: 0 in 0.294s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.397s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059871794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549e7f1d-525c-4438-9399-f5e5253b5380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:34Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Creating volume 549e7f1d-525c-4438-9399-f5e5253b5380 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:37 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42bb54b-2007-49ac-8a69-c6f681c08717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d9fb67-a2c3-411d-b69f-50891232bd97', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2853951-4d48-4ed0-b61d-bea68b06c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:38 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 1073741824 Nov 02 14:40:38 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:38 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Volume volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 (e7d9fb67-a2c3-411d-b69f-50891232bd97): created successfully Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2853951-4d48-4ed0-b61d-bea68b06c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (75394902-e636-4ac7-a381-860562175678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b6b95765-5526-4e0b-a5a6-b9d293920dd9 tempest-CreateVolumesFromImageTest-1773206675 None] Created volume successfully. Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d6128e-d060-47dd-8b85-7fce8480d1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd2a1e96-73a6-43d9-a104-a3828cf397b5', 'volume_name': 'volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5', 'volume_size': 1, 'image_id': 'da778a6e-e808-4bac-b7ea-f820b43e99d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da778a6e-e808-4bac-b7ea-f820b43e99d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '668b9110a75895061e144ea56d9cf941', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6aa3ffa7c14f43bea368ac78c3f563cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01d2b110ac2fe929df9f0f9019b7027ec77fc5dbeae47a924d10a238a48b2d2a7bb6a2a9ce6a2fb4aa7dd1233790fc97e46cccf21dd81e606b3e6a0ba2debbcd', 'id': 'da778a6e-e808-4bac-b7ea-f820b43e99d8', 'created_at': datetime.datetime(2026, 11, 2, 13, 40, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 40, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da778a6e-e808-4bac-b7ea-f820b43e99d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82550d1f-ad71-4e49-aeb5-2262f478c251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82550d1f-ad71-4e49-aeb5-2262f478c251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d311af-c86d-4841-8800-8b8b78e8f12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:38 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Volume fd2a1e96-73a6-43d9-a104-a3828cf397b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5', 'volume_size': 1, 'image_id': 'da778a6e-e808-4bac-b7ea-f820b43e99d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da778a6e-e808-4bac-b7ea-f820b43e99d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '668b9110a75895061e144ea56d9cf941', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6aa3ffa7c14f43bea368ac78c3f563cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01d2b110ac2fe929df9f0f9019b7027ec77fc5dbeae47a924d10a238a48b2d2a7bb6a2a9ce6a2fb4aa7dd1233790fc97e46cccf21dd81e606b3e6a0ba2debbcd', 'id': 'da778a6e-e808-4bac-b7ea-f820b43e99d8', 'created_at': datetime.datetime(2026, 11, 2, 13, 40, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 40, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da778a6e-e808-4bac-b7ea-f820b43e99d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Trying to clone fd2a1e96-73a6-43d9-a104-a3828cf397b5 from image da778a6e-e808-4bac-b7ea-f820b43e99d8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/da778a6e-e808-4bac-b7ea-f820b43e99d8', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:40:38 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Image download 0.00 MB at 0.00 MB/s Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3917b00c-87ab-45a2-b41f-9faada5576bf]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:38 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD Nov 02 14:40:38 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:38 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 1073741824" returned: 0 in 0.572s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:38 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 Nov 02 14:40:38 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:38 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:38 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380" returned: 0 in 0.259s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:38 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD Nov 02 14:40:38 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.903s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-773396788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ecee7-25cf-491e-9983-87d51439b1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c17f8731de459a9986933f888bf222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:35Z,use_quota=True,user_id='e2c490c26d1245dda8639b36a66ecbf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Creating volume 730ecee7-25cf-491e-9983-87d51439b1da {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:38 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a603b1b-1ef2-498b-aaef-6ff99088058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549e7f1d-525c-4438-9399-f5e5253b5380', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:38 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da 1073741824 Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbf527b-b109-4cb2-9b6d-1ff345591d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:38 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:38 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Volume volume-549e7f1d-525c-4438-9399-f5e5253b5380 (549e7f1d-525c-4438-9399-f5e5253b5380): created successfully Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbf527b-b109-4cb2-9b6d-1ff345591d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (1651ac5f-4e47-4694-a788-0aa0cf0fdf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ec2408cf-dc51-43c4-bd6a-0ffb657a37a7 tempest-CreateVolumesFromImageTest-1773206675 None] Created volume successfully. Nov 02 14:40:39 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Temporary image da778a6e-e808-4bac-b7ea-f820b43e99d8 is fetched for user d90fb239cc0b4a44b434ae782b50491e. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:39 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:39 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a6ee1b-8b9a-4aa6-ae80-62e7e8923abe]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:39 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD Nov 02 14:40:39 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:39 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da 1073741824" returned: 0 in 0.451s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:39 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:39 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.275s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:39 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:40:39 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:39 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da" returned: 0 in 0.307s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-730305930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b0460a-bcee-45f8-91b0-1af8f82acbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:36Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Creating volume 77b0460a-bcee-45f8-91b0-1af8f82acbfa {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:39 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:39 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD Nov 02 14:40:39 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:39 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa 1073741824 Nov 02 14:40:39 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae386cbf-fb12-45ac-9184-312bf6fa0a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730ecee7-25cf-491e-9983-87d51439b1da', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85520831-1934-4c1d-9b1c-e42cd84911ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:39 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Volume volume-730ecee7-25cf-491e-9983-87d51439b1da (730ecee7-25cf-491e-9983-87d51439b1da): created successfully Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85520831-1934-4c1d-9b1c-e42cd84911ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Flow 'volume_create_manager' (a96b2531-00a0-478e-855d-758e77564ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:39 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c736cd9d-482d-4745-841d-cb905a379dcc tempest-CreateVolumesFromImageTest-1773206675 None] Created volume successfully. Nov 02 14:40:39 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:40 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa 1073741824" returned: 0 in 0.428s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:40 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa Nov 02 14:40:40 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:40 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa" returned: 0 in 0.242s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.838s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1099060695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e146da-9f6b-4357-a4b0-e97b86501800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:36Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Creating volume 92e146da-9f6b-4357-a4b0-e97b86501800 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:40 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47391249-989f-4138-aeab-abc71aacf3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:40 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 1073741824 Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ddb22a-2171-46ba-9733-e92ab231008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:40 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:40 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa (77b0460a-bcee-45f8-91b0-1af8f82acbfa): created successfully Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ddb22a-2171-46ba-9733-e92ab231008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (7fd1bddb-b73d-490f-8eff-fbfac6657081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:40 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d963acff-a2c0-4b5f-91f2-65ede0a5b63e tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created volume successfully. Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-730ecee7-25cf-491e-9983-87d51439b1da-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-730ecee7-25cf-491e-9983-87d51439b1da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-quobyte-730ecee7-25cf-491e-9983-87d51439b1da" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:40 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 1073741824" returned: 0 in 0.503s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-730ecee7-25cf-491e-9983-87d51439b1da" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[da44770c-65f2-4ff5-a54e-01f4bdf9c847]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:41 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 Nov 02 14:40:41 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:41 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da Nov 02 14:40:41 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:41 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.256s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1735413113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a57dd7fc-d20c-4045-8c3a-e3a59d17457e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:37Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Creating volume a57dd7fc-d20c-4045-8c3a-e3a59d17457e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:41 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c16b27a2-ceb0-4d26-8cf6-99fd2d870e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e146da-9f6b-4357-a4b0-e97b86501800', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:41 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e 1073741824 Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbde732-121f-46d0-997d-6770f3dfd02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:41 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:41 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume volume-92e146da-9f6b-4357-a4b0-e97b86501800 (92e146da-9f6b-4357-a4b0-e97b86501800): created successfully Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbde732-121f-46d0-997d-6770f3dfd02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (5b7437f3-a3e7-4e11-87a6-73d40a80a3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:41 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3ae55965-a1f3-4435-8792-8127fb71588d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created volume successfully. Nov 02 14:40:41 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da" returned: 0 in 0.381s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:41 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da Nov 02 14:40:41 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:41 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-730ecee7-25cf-491e-9983-87d51439b1da" returned: 0 in 0.293s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-730ecee7-25cf-491e-9983-87d51439b1da" released by "delete_volume" :: held 0.718s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Created reservations ['38db704a-a53c-4c26-9129-d7c17c2ef535', '430942cf-2c7d-4921-8335-16e02b1db533', '67e25994-abdc-4e77-b909-628d012ce2b2', 'e9778dcf-5893-4251-bafc-1870ea9285fa'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:41 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e 1073741824" returned: 0 in 0.464s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:41 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e Nov 02 14:40:41 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:41 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:41 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-549e7f1d-525c-4438-9399-f5e5253b5380-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-549e7f1d-525c-4438-9399-f5e5253b5380-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:42 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e" returned: 0 in 0.313s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.516s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1735162347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04180285-b04f-4de6-a5c7-63b436d26c45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:37Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Creating volume 04180285-b04f-4de6-a5c7-63b436d26c45 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:42 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:42 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.316s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:42 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 1073741824 Nov 02 14:40:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Deleted volume successfully. Nov 02 14:40:42 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc8765e-0589-4d79-bbe1-0d4d5fbb3215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9eafc8-0051-4546-8332-a2bfaf007ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-quobyte-549e7f1d-525c-4438-9399-f5e5253b5380" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e (a57dd7fc-d20c-4045-8c3a-e3a59d17457e): created successfully Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9eafc8-0051-4546-8332-a2bfaf007ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (4c137f09-e493-4ea7-a77d-952ce924c9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-549e7f1d-525c-4438-9399-f5e5253b5380" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73cd3abe-2591-4c1b-ae04-418cd0d27ae1 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-730ecee7-25cf-491e-9983-87d51439b1da-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3b7f4725-037a-48a3-8900-d2c6016c36cb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created volume successfully. Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab6b2b-b69e-48c4-9e3d-d8ba78f974c3]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:42 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 Nov 02 14:40:42 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:42 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 1073741824" returned: 0 in 0.440s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:42 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 Nov 02 14:40:42 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:42 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380" returned: 0 in 0.399s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:42 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380 Nov 02 14:40:42 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:42 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45" returned: 0 in 0.249s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.849s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961149331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1854900d-2a98-41ea-a876-c8402d12ea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac669a60185e444cb2b1da21ef8ebc18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:38Z,use_quota=True,user_id='edb4bb5ed3da4e7ead22894f3382c6f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Creating volume 1854900d-2a98-41ea-a876-c8402d12ea56 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:42 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775cfade-3bcc-49e5-8021-e6db912b02b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04180285-b04f-4de6-a5c7-63b436d26c45', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:42 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 1073741824 Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb6d311-0ac6-4658-8dc2-aedd039ea57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:42 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:42 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-549e7f1d-525c-4438-9399-f5e5253b5380" returned: 0 in 0.260s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-549e7f1d-525c-4438-9399-f5e5253b5380" released by "delete_volume" :: held 0.710s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume volume-04180285-b04f-4de6-a5c7-63b436d26c45 (04180285-b04f-4de6-a5c7-63b436d26c45): created successfully Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb6d311-0ac6-4658-8dc2-aedd039ea57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (2212da23-0ff9-4953-bf5e-d1654f4dfd0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5ad702e5-3ed4-4a90-ae43-f7339c6769bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created volume successfully. Nov 02 14:40:42 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Created reservations ['5097fb24-c083-47a2-bb7b-9f6ef400583c', '4574732a-3fee-493d-9b62-b673186e8bd7', '2ec24499-92f7-4565-835d-41e5a20e99e2', 'fa100269-40e6-46b7-ba61-309f482613b3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:43 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:43 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-e7d9fb67-a2c3-411d-b69f-50891232bd97-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-e7d9fb67-a2c3-411d-b69f-50891232bd97-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:43 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.276s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Deleted volume successfully. Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-quobyte-e7d9fb67-a2c3-411d-b69f-50891232bd97" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-e7d9fb67-a2c3-411d-b69f-50891232bd97" acquired by "delete_volume" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-da7a68f1-edcf-4c06-a729-6fe706a003ad tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-549e7f1d-525c-4438-9399-f5e5253b5380-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6f16de-0036-4ed1-bf08-f724bae58421]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:43 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 1073741824" returned: 0 in 0.581s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:43 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 Nov 02 14:40:43 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:43 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 Nov 02 14:40:43 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:43 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56" returned: 0 in 0.271s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.253s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Creating offline snapshot db5dc20a-b6fb-4a85-b90d-24514e17c847 of volume 7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:40:43 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d859f8ed-0b9d-444b-b3c6-7a5ce1313b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1854900d-2a98-41ea-a876-c8402d12ea56', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d19048f-9d59-4653-80da-c37626c21c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bfb866-7e72-4538-b3da-79c9317af4e0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97" returned: 0 in 0.407s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Volume volume-1854900d-2a98-41ea-a876-c8402d12ea56 (1854900d-2a98-41ea-a876-c8402d12ea56): created successfully Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d19048f-9d59-4653-80da-c37626c21c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Flow 'volume_create_manager' (54167f6c-8aa7-48d7-885a-c891324533ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:43 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97 Nov 02 14:40:43 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cd8e31e0-8492-4e58-8cd3-e127800d2a17 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created volume successfully. Nov 02 14:40:43 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e Nov 02 14:40:43 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:44 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e7d9fb67-a2c3-411d-b69f-50891232bd97" returned: 0 in 0.261s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-e7d9fb67-a2c3-411d-b69f-50891232bd97" released by "delete_volume" :: held 0.719s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Created reservations ['72315516-345d-4a1d-9506-2f6cc4b48905', 'e9a125a4-a865-4467-960a-7e33cf73792c', '1c647a2e-076f-4672-be17-c182b2f74ae1', 'edf883ae-f023-4a9d-b36f-8b320e6ba9e3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:44 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e" returned: 0 in 0.366s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:44 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 1G Nov 02 14:40:44 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:44 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:44 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:44 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-1854900d-2a98-41ea-a876-c8402d12ea56-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:44 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Deleted volume successfully. Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-1854900d-2a98-41ea-a876-c8402d12ea56-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-29508b1e-ead5-49f1-a7e4-37a0067bb3ac tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-e7d9fb67-a2c3-411d-b69f-50891232bd97-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-quobyte-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-quobyte-1854900d-2a98-41ea-a876-c8402d12ea56" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-1854900d-2a98-41ea-a876-c8402d12ea56" acquired by "delete_volume" :: waited 0.034s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a184a64-0569-4fd3-acd0-be46996a87d7]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:44 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 1G" returned: 0 in 0.513s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2f126e-a314-4305-821a-1dc509887f7e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebfa75c-54db-44fc-af45-d4302fdae9ba]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:44 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2f126e-a314-4305-821a-1dc509887f7e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 Nov 02 14:40:44 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:44 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b Nov 02 14:40:44 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:44 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 Nov 02 14:40:44 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:44 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a2f126e-a314-4305-821a-1dc509887f7e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:44 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 is being set with open permissions: ugo+rw Nov 02 14:40:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:44 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 Nov 02 14:40:44 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:45 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56" returned: 0 in 0.395s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b Nov 02 14:40:45 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:45 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56 Nov 02 14:40:45 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:45 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b" returned: 0 in 0.254s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.info Nov 02 14:40:45 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b" released by "delete_volume" :: held 0.723s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:45 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-1854900d-2a98-41ea-a876-c8402d12ea56" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-1854900d-2a98-41ea-a876-c8402d12ea56" released by "delete_volume" :: held 0.726s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Created reservations ['38145627-6d2e-4dbe-8592-7467452bbaf4', '380fade5-11f8-44b8-9aca-2ad07fbed94c', '59a20e20-25d0-48e8-88e5-b26d664a1403', 'd313e8ac-d687-4ac1-a489-fd6c574a49d6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created reservations ['c5067600-2d03-46c5-b210-4953bd084b7f', '907f8d9f-d7b3-4914-a906-ad13537bffb6', 'da9c5337-008b-4ba5-b360-adf3f75c2eb3', '85b83747-0a96-4a91-8014-ac01ea968034'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:45 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:45 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:45 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:45 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.info" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.info is being set with open permissions: ugo+rw Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.info Nov 02 14:40:45 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-04180285-b04f-4de6-a5c7-63b436d26c45-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-04180285-b04f-4de6-a5c7-63b436d26c45-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "cinder-quobyte-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-quobyte-04180285-b04f-4de6-a5c7-63b436d26c45" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:45 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.355s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-04180285-b04f-4de6-a5c7-63b436d26c45" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:45 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e715b57-1d06-43d8-814e-7ef08e5d2c6a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Deleted volume successfully. Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7477986-9f70-4e4b-8ea2-794e6a5a2db5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.473s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:45 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:45 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Deleted volume successfully. Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-73e39cee-c71e-46ce-99e9-59ec1a94923d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-1854900d-2a98-41ea-a876-c8402d12ea56-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-62b486b7-8f8d-4e16-9660-924e82606010 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-c35cc0ea-b1a7-4fee-ad3c-16027f42c02b-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:46 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.info" returned: 0 in 0.454s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.099s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2a1e96-73a6-43d9-a104-a3828cf397b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa3ffa7c14f43bea368ac78c3f563cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:38Z,use_quota=True,user_id='d90fb239cc0b4a44b434ae782b50491e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0be13e4-df35-4412-bee2-c996db50d198),volume_type_id=a0be13e4-df35-4412-bee2-c996db50d198)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Creating volume fd2a1e96-73a6-43d9-a104-a3828cf397b5 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:46 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:46 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f Nov 02 14:40:46 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:46 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 1073741824 Nov 02 14:40:46 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7c78a0e9-0798-4752-a545-b553c609c866 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Create snapshot completed successfully Nov 02 14:40:46 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 Nov 02 14:40:46 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:46 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f" returned: 0 in 0.444s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:46 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45" returned: 0 in 0.440s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:46 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f Nov 02 14:40:46 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:46 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45 Nov 02 14:40:46 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:46 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 1073741824" returned: 0 in 0.484s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:46 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 Nov 02 14:40:46 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:46 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f" returned: 0 in 0.302s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:46 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-quobyte-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f" released by "delete_volume" :: held 0.827s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-04180285-b04f-4de6-a5c7-63b436d26c45" returned: 0 in 0.308s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-04180285-b04f-4de6-a5c7-63b436d26c45" released by "delete_volume" :: held 0.818s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Created reservations ['efd9890a-e529-4608-8da6-e1a68f43468c', '12d0da72-aff9-46d8-a317-63585feb1db0', 'dc236916-264e-4e6c-b1d0-8097bb8ccacf', 'f07b439f-c582-448d-a486-e27335248ae6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created reservations ['f2c60245-7aae-456b-bd3b-42aa9fbf4c93', '613eaada-b317-408d-8c72-941c2894da4c', '6cb98481-9e46-4186-91b6-299d31e05dbb', 'b36d8363-d376-45c7-ab2a-62a57ecbe6d3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:46 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:46 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:46 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5" returned: 0 in 0.337s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-a57dd7fc-d20c-4045-8c3a-e3a59d17457e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Attempting download of da778a6e-e808-4bac-b7ea-f820b43e99d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/da778a6e-e808-4bac-b7ea-f820b43e99d8', 'metadata': {}}])) to volume fd2a1e96-73a6-43d9-a104-a3828cf397b5. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:40:47 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:47 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-a57dd7fc-d20c-4045-8c3a-e3a59d17457e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-quobyte-a57dd7fc-d20c-4045-8c3a-e3a59d17457e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de371d-bfb9-41dc-b636-49585e9c7065]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da778a6e-e808-4bac-b7ea-f820b43e99d8_g6hiaq7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-a57dd7fc-d20c-4045-8c3a-e3a59d17457e" acquired by "delete_volume" :: waited 0.056s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89b307c-22e8-486a-bb95-a595a91eabf8]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:47 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.376s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:47 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da778a6e-e808-4bac-b7ea-f820b43e99d8_g6hiaq7b Nov 02 14:40:47 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Deleted volume successfully. Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f96fbf2f-8996-46fe-bcb0-cb2e12d8626d tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-04180285-b04f-4de6-a5c7-63b436d26c45-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:47 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e Nov 02 14:40:47 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:47 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.556s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Deleted volume successfully. Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a3aac76f-60a4-427b-a084-68a52b69be80 tempest-CreateVolumesFromImageTest-1773206675 None] Lock "cinder-8ec706cc-ad2c-4835-8a3e-4e21ef0c376f-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (4147fcff-fa8e-4b5c-838a-57a8f5d2a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9d9857-30b8-422d-b255-ddff6bbf08cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9d9857-30b8-422d-b255-ddff6bbf08cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800642654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a46eea-3db8-4a85-8a7a-c50741434987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:48Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935271b5-4a78-4006-be63-7f4a8698b081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:47 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935271b5-4a78-4006-be63-7f4a8698b081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dff30dd-de93-463d-bd0e-4dbbd52d0f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dff30dd-de93-463d-bd0e-4dbbd52d0f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a46eea-3db8-4a85-8a7a-c50741434987', 'volume_name': 'volume-57a46eea-3db8-4a85-8a7a-c50741434987', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0f00cc-cca3-47cf-8887-3595ad42f8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0f00cc-cca3-47cf-8887-3595ad42f8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe415f7-d053-47a1-b277-875008494b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:47 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume 57a46eea-3db8-4a85-8a7a-c50741434987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a46eea-3db8-4a85-8a7a-c50741434987', 'volume_size': 1} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800642654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a46eea-3db8-4a85-8a7a-c50741434987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:48Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Creating volume 57a46eea-3db8-4a85-8a7a-c50741434987 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:47 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da778a6e-e808-4bac-b7ea-f820b43e99d8_g6hiaq7b" returned: 0 in 0.580s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:47 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da778a6e-e808-4bac-b7ea-f820b43e99d8_g6hiaq7b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e" returned: 0 in 0.502s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:47 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 1073741824 Nov 02 14:40:47 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:47 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e Nov 02 14:40:47 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:47 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da778a6e-e808-4bac-b7ea-f820b43e99d8_g6hiaq7b Nov 02 14:40:47 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (13364ea8-72bf-4856-9787-4d5cc2bedfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cc9183-42c8-44dd-ac47-c68ccfac329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cc9183-42c8-44dd-ac47-c68ccfac329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259706881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ba67e-1f06-4348-83c5-c3611683e533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:48Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a420e6-54ce-4212-b4d9-314fa6a23389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a420e6-54ce-4212-b4d9-314fa6a23389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834e6413-b13d-477f-a3de-921b40330f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834e6413-b13d-477f-a3de-921b40330f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45ba67e-1f06-4348-83c5-c3611683e533', 'volume_name': 'volume-c45ba67e-1f06-4348-83c5-c3611683e533', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d635b3-4d4f-4565-a501-36600fbdea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d635b3-4d4f-4565-a501-36600fbdea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6955dfd8-629e-47cc-a313-b4bbdb618dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume c45ba67e-1f06-4348-83c5-c3611683e533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45ba67e-1f06-4348-83c5-c3611683e533', 'volume_size': 1} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a57dd7fc-d20c-4045-8c3a-e3a59d17457e" returned: 0 in 0.530s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da778a6e-e808-4bac-b7ea-f820b43e99d8_g6hiaq7b" returned: 1 in 0.563s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da778a6e-e808-4bac-b7ea-f820b43e99d8_g6hiaq7b' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b243976d-4305-446f-9889-ceef0d62383d]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-a57dd7fc-d20c-4045-8c3a-e3a59d17457e" released by "delete_volume" :: held 1.129s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created reservations ['d76c6b8b-7e2b-4fdc-a016-3a31a1c386a1', '17266c58-80ad-4a07-97df-d8bb410ab150', 'aacd195e-1943-4516-beb3-f357651b8f16', 'a4674abd-7a10-4a30-90be-de41d63ea670'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:48 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 1073741824" returned: 0 in 0.715s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:48 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 Nov 02 14:40:48 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:48 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD Nov 02 14:40:48 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:48 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:48 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:48 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.506s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259706881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ba67e-1f06-4348-83c5-c3611683e533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:48Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Creating volume c45ba67e-1f06-4348-83c5-c3611683e533 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:48 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe415f7-d053-47a1-b277-875008494b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a46eea-3db8-4a85-8a7a-c50741434987', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 1073741824 Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e488b4a1-89b0-4e90-b8c3-d9fec8f5c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (3934745d-7154-4538-be0a-2ea9167fdaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:48 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8918983c-634d-43aa-b9c2-d595ddf69dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.372s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:48 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8918983c-634d-43aa-b9c2-d595ddf69dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1521899907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2187227-8d3e-4c65-8544-3177b65ed650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:49Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db045bff-617d-4eee-848d-7b8d0733b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db045bff-617d-4eee-848d-7b8d0733b788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8649ed60-0f82-4dc9-a6f7-eef698ee4d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8649ed60-0f82-4dc9-a6f7-eef698ee4d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2187227-8d3e-4c65-8544-3177b65ed650', 'volume_name': 'volume-b2187227-8d3e-4c65-8544-3177b65ed650', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facfa871-f213-406a-a7b7-3e588e9bf5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (facfa871-f213-406a-a7b7-3e588e9bf5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbe3728-b4c6-48bb-897a-fcb9399e73c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:48 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume b2187227-8d3e-4c65-8544-3177b65ed650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2187227-8d3e-4c65-8544-3177b65ed650', 'volume_size': 1} Nov 02 14:40:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Deleted volume successfully. Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:49 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume volume-57a46eea-3db8-4a85-8a7a-c50741434987 (57a46eea-3db8-4a85-8a7a-c50741434987): created successfully Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e488b4a1-89b0-4e90-b8c3-d9fec8f5c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (4147fcff-fa8e-4b5c-838a-57a8f5d2a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ade8f888-0633-4f06-a2d6-75c57c6903a9 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-a57dd7fc-d20c-4045-8c3a-e3a59d17457e-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e2b6e725-e277-48d0-84c9-8fc2220056eb tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created volume successfully. Nov 02 14:40:49 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD Nov 02 14:40:49 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (40bb8838-693d-4861-8679-a81ef51f2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827b50d4-75a5-4c23-a045-c4a46c8b2a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:49 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-92e146da-9f6b-4357-a4b0-e97b86501800-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 1073741824" returned: 0 in 0.742s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827b50d4-75a5-4c23-a045-c4a46c8b2a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257608908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fa0249-7505-4030-9b8b-a3aa419ba221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:49Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079d8d94-15c5-4102-ba4c-e2b64c2e6bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079d8d94-15c5-4102-ba4c-e2b64c2e6bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d76cf1-21da-406b-92eb-dbbacf381853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d76cf1-21da-406b-92eb-dbbacf381853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91fa0249-7505-4030-9b8b-a3aa419ba221', 'volume_name': 'volume-91fa0249-7505-4030-9b8b-a3aa419ba221', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae23c18-3262-45f5-ad98-86e43b26e271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae23c18-3262-45f5-ad98-86e43b26e271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf0f241-2d51-483a-8dc7-3e544edabd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:49 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume 91fa0249-7505-4030-9b8b-a3aa419ba221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91fa0249-7505-4030-9b8b-a3aa419ba221', 'volume_size': 1} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-92e146da-9f6b-4357-a4b0-e97b86501800-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:49 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD" returned: 1 in 0.629s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] da778a6e-e808-4bac-b7ea-f820b43e99d8 was raw, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:49 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 Nov 02 14:40:49 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-quobyte-92e146da-9f6b-4357-a4b0-e97b86501800" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:49 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 Nov 02 14:40:49 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-92e146da-9f6b-4357-a4b0-e97b86501800" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeb6ad5-b0bc-49cc-a730-40755d209c9d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (39a2696b-ad33-4314-831e-404f9d76bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6480a3a-c765-4529-b6ac-6eb8e0aba72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6480a3a-c765-4529-b6ac-6eb8e0aba72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-458867166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba7bbde-bfdf-49fe-a2ec-f65314af2444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:50Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f6f9a4-0337-4420-ac1b-1247497e4291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f6f9a4-0337-4420-ac1b-1247497e4291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0ff92e-69e9-4cbc-b3c1-d03336d55362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0ff92e-69e9-4cbc-b3c1-d03336d55362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba7bbde-bfdf-49fe-a2ec-f65314af2444', 'volume_name': 'volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927d0f9f-cab0-4964-8e1d-0ccb0d75c955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927d0f9f-cab0-4964-8e1d-0ccb0d75c955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c648ff2-814f-4ade-856f-d92e0404fef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:50 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume 9ba7bbde-bfdf-49fe-a2ec-f65314af2444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444', 'volume_size': 1} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:50 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 Nov 02 14:40:50 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:50 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533" returned: 0 in 0.390s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1521899907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2187227-8d3e-4c65-8544-3177b65ed650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:49Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Creating volume b2187227-8d3e-4c65-8544-3177b65ed650 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:50 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6955dfd8-629e-47cc-a313-b4bbdb618dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45ba67e-1f06-4348-83c5-c3611683e533', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce8a448-2aaa-44dd-9ae8-422f07cdb69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:50 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 1073741824 Nov 02 14:40:50 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:50 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume volume-c45ba67e-1f06-4348-83c5-c3611683e533 (c45ba67e-1f06-4348-83c5-c3611683e533): created successfully Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce8a448-2aaa-44dd-9ae8-422f07cdb69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (13364ea8-72bf-4856-9787-4d5cc2bedfb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0db1288e-a84a-4bcc-8e04-9bd4964b9029 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created volume successfully. Nov 02 14:40:50 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5" returned: 0 in 0.679s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da778a6e-e808-4bac-b7ea-f820b43e99d8_yar7sk1rdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:40:50 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:50 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 1G Nov 02 14:40:50 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:50 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800" returned: 0 in 0.550s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:50 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800 Nov 02 14:40:50 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:50 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-92e146da-9f6b-4357-a4b0-e97b86501800" returned: 0 in 0.362s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-92e146da-9f6b-4357-a4b0-e97b86501800" released by "delete_volume" :: held 1.005s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:50 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 1073741824" returned: 0 in 0.680s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:50 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 1G" returned: 0 in 0.474s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Downloaded image da778a6e-e808-4bac-b7ea-f820b43e99d8 ((None, [{'url': 'file:///opt/stack/data/glance/images/da778a6e-e808-4bac-b7ea-f820b43e99d8', 'metadata': {}}])) to volume fd2a1e96-73a6-43d9-a104-a3828cf397b5 successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Temporary image da778a6e-e808-4bac-b7ea-f820b43e99d8 for user d90fb239cc0b4a44b434ae782b50491e is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Marking volume fd2a1e96-73a6-43d9-a104-a3828cf397b5 as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Copying metadata from image da778a6e-e808-4bac-b7ea-f820b43e99d8 to fd2a1e96-73a6-43d9-a104-a3828cf397b5. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Creating volume glance metadata for volume fd2a1e96-73a6-43d9-a104-a3828cf397b5 backed by image da778a6e-e808-4bac-b7ea-f820b43e99d8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'da778a6e-e808-4bac-b7ea-f820b43e99d8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '668b9110a75895061e144ea56d9cf941', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:50 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 Nov 02 14:40:50 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:50 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created reservations ['f26a3ae1-9dea-4ebf-8850-b36e5a404b13', 'd6c0c74d-7d4b-474c-88ed-58394cb03226', '321c6df8-eec8-4bc3-a8cd-948ee089c296', '6c1d71dd-2c41-4046-86cb-f7bebc4993b9'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d311af-c86d-4841-8800-8b8b78e8f12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5', 'volume_size': 1, 'image_id': 'da778a6e-e808-4bac-b7ea-f820b43e99d8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da778a6e-e808-4bac-b7ea-f820b43e99d8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '668b9110a75895061e144ea56d9cf941', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6aa3ffa7c14f43bea368ac78c3f563cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '01d2b110ac2fe929df9f0f9019b7027ec77fc5dbeae47a924d10a238a48b2d2a7bb6a2a9ce6a2fb4aa7dd1233790fc97e46cccf21dd81e606b3e6a0ba2debbcd', 'id': 'da778a6e-e808-4bac-b7ea-f820b43e99d8', 'created_at': datetime.datetime(2026, 11, 2, 13, 40, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 40, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da778a6e-e808-4bac-b7ea-f820b43e99d8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0291e17e-8de9-45a6-b294-40f8295cc0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Volume volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 (fd2a1e96-73a6-43d9-a104-a3828cf397b5): created successfully Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0291e17e-8de9-45a6-b294-40f8295cc0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Flow 'volume_create_manager' (33ad09bc-e9da-498b-ad75-19c76bfa0843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-816ee53d-239a-4991-8981-9d0f65f27926 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Created volume successfully. Nov 02 14:40:51 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:51 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:51 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650" returned: 0 in 0.327s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.561s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257608908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fa0249-7505-4030-9b8b-a3aa419ba221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:49Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Creating volume 91fa0249-7505-4030-9b8b-a3aa419ba221 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:51 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbe3728-b4c6-48bb-897a-fcb9399e73c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2187227-8d3e-4c65-8544-3177b65ed650', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26f66a0-0a2f-4fb5-8063-89591e13cb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:51 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 1073741824 Nov 02 14:40:51 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume volume-b2187227-8d3e-4c65-8544-3177b65ed650 (b2187227-8d3e-4c65-8544-3177b65ed650): created successfully Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26f66a0-0a2f-4fb5-8063-89591e13cb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (3934745d-7154-4538-be0a-2ea9167fdaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-46be230b-3fcc-4585-95fc-954c048301b7 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created volume successfully. Nov 02 14:40:51 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.287s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Deleted volume successfully. Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a12310d1-f7af-4999-a03b-93fcc19aa9bb tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-92e146da-9f6b-4357-a4b0-e97b86501800-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:51 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 1073741824" returned: 0 in 0.491s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:51 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 Nov 02 14:40:51 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-77b0460a-bcee-45f8-91b0-1af8f82acbfa-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-77b0460a-bcee-45f8-91b0-1af8f82acbfa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Acquiring lock "cinder-fd2a1e96-73a6-43d9-a104-a3828cf397b5-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "cinder-fd2a1e96-73a6-43d9-a104-a3828cf397b5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-quobyte-77b0460a-bcee-45f8-91b0-1af8f82acbfa" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:51 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-77b0460a-bcee-45f8-91b0-1af8f82acbfa" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Acquiring lock "cinder-quobyte-fd2a1e96-73a6-43d9-a104-a3828cf397b5" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d37aded-0e65-441e-96ff-99aa4a2dc7ee]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "cinder-quobyte-fd2a1e96-73a6-43d9-a104-a3828cf397b5" acquired by "delete_volume" :: waited 0.047s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89ee7b8-af55-4590-ac3e-45ced9f03e9b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:52 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221" returned: 0 in 0.411s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-458867166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba7bbde-bfdf-49fe-a2ec-f65314af2444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8aeed4ae98c443fb2ad42afeb0f9a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:40:50Z,use_quota=True,user_id='320d8255345144c9809bc4f664fb600d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Creating volume 9ba7bbde-bfdf-49fe-a2ec-f65314af2444 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:52 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa Nov 02 14:40:52 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:40:52 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:52 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 1073741824 Nov 02 14:40:52 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf0f241-2d51-483a-8dc7-3e544edabd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91fa0249-7505-4030-9b8b-a3aa419ba221', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526c02df-afda-4764-9d72-c7e12c455afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:52 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 Nov 02 14:40:52 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:52 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume volume-91fa0249-7505-4030-9b8b-a3aa419ba221 (91fa0249-7505-4030-9b8b-a3aa419ba221): created successfully Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526c02df-afda-4764-9d72-c7e12c455afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (40bb8838-693d-4861-8679-a81ef51f2194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:52 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1decc284-e148-44f8-8682-2a872e6f1f58 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created volume successfully. Nov 02 14:40:52 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa" returned: 0 in 0.472s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:52 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa Nov 02 14:40:52 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:52 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5" returned: 0 in 0.458s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:52 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5 Nov 02 14:40:52 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:52 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 1073741824" returned: 0 in 0.583s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:52 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-77b0460a-bcee-45f8-91b0-1af8f82acbfa" returned: 0 in 0.323s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:52 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-77b0460a-bcee-45f8-91b0-1af8f82acbfa" released by "delete_volume" :: held 0.869s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:52 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:52 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-fd2a1e96-73a6-43d9-a104-a3828cf397b5" returned: 0 in 0.318s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created reservations ['12ada8f2-7c57-4cfa-b95a-10aa59ad47f1', 'b007169b-3286-4fbd-89fe-7b4fae7e70b9', 'dccca068-a80f-4239-9167-912e51ed5aaa', 'e7d1ea05-81ba-43d7-92bf-4d6e01905c35'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "cinder-quobyte-fd2a1e96-73a6-43d9-a104-a3828cf397b5" released by "delete_volume" :: held 0.857s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Created reservations ['1e5f2b71-fec9-418f-93ef-a93a84c24432', '92ff198a-63d1-428d-af78-abbb8cba551e', '6b8e6710-8371-4691-abde-f7a5787b618f', '14acb8c2-1a99-42b2-9d85-24d2eb40883a'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:53 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:53 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-67015670-4fe7-4c09-9ab5-b2fe46a70899-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:53 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444" returned: 0 in 0.349s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-67015670-4fe7-4c09-9ab5-b2fe46a70899-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c648ff2-814f-4ade-856f-d92e0404fef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7779295-c043-42c1-909d-43ab02d285da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:40:53 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Volume volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 (9ba7bbde-bfdf-49fe-a2ec-f65314af2444): created successfully Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7779295-c043-42c1-909d-43ab02d285da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Flow 'volume_create_manager' (39a2696b-ad33-4314-831e-404f9d76bc27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "cinder-quobyte-67015670-4fe7-4c09-9ab5-b2fe46a70899" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-25dec520-1194-4965-ac23-b5afa2a01db5 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created volume successfully. Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-67015670-4fe7-4c09-9ab5-b2fe46a70899" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:53 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:53 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a14faea-93d7-4f2c-8756-54e1e0c35988]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-9ba7bbde-bfdf-49fe-a2ec-f65314af2444-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-9ba7bbde-bfdf-49fe-a2ec-f65314af2444-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-9ba7bbde-bfdf-49fe-a2ec-f65314af2444" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:53 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.521s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-9ba7bbde-bfdf-49fe-a2ec-f65314af2444" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:53 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 Nov 02 14:40:53 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Deleted volume successfully. Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e210067f-4bbb-4e3d-aa25-6a551351c38f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:53 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.455s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a8626ce-ee86-4c31-bd50-e461b4d6f601 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-77b0460a-bcee-45f8-91b0-1af8f82acbfa-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Deleted volume successfully. Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-3e2cf0a5-cc05-4d3b-aef8-abc6882f9e89 tempest-VolumeAndVolumeTypeFromImageTest-1771694315 None] Lock "cinder-fd2a1e96-73a6-43d9-a104-a3828cf397b5-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:53 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 Nov 02 14:40:53 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899" returned: 0 in 0.597s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:53 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:53 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899 Nov 02 14:40:53 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:54 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444" returned: 0 in 0.523s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:54 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444 Nov 02 14:40:54 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:54 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-67015670-4fe7-4c09-9ab5-b2fe46a70899" returned: 0 in 0.389s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-quobyte-67015670-4fe7-4c09-9ab5-b2fe46a70899" released by "delete_volume" :: held 1.048s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Created reservations ['584da373-300d-43c2-b46f-02fb5e940aa4', 'b1e0fd30-9d24-456a-958b-d2936d4448bb', 'ec7712c3-3ec6-4da1-9451-51dac5139cea', '68feaaca-02bd-4cb8-87bd-e4dea456af83'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:54 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-9ba7bbde-bfdf-49fe-a2ec-f65314af2444" returned: 0 in 0.440s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:54 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:54 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-9ba7bbde-bfdf-49fe-a2ec-f65314af2444" released by "delete_volume" :: held 1.075s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created reservations ['dd518642-0100-4ac1-a787-7b3574761bee', '7405299d-79bd-4b13-a50f-c6eb6c94e5f0', '0d28ffd4-7b05-4837-a8e2-1bcd36ecc4f9', '3c201437-551d-42d3-afb3-f3b0a8c71377'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:54 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:54 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:54 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:54 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Deleted volume successfully. Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0ebe2567-06f8-4856-baab-a880a1e44a90 tempest-CreateVolumesFromSourceVolumeTest-564444641 None] Lock "cinder-67015670-4fe7-4c09-9ab5-b2fe46a70899-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:55 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.287s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Deleted volume successfully. Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-59ae1cba-5e69-4d88-9492-2415eb1fb7bc tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-9ba7bbde-bfdf-49fe-a2ec-f65314af2444-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-91fa0249-7505-4030-9b8b-a3aa419ba221-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-91fa0249-7505-4030-9b8b-a3aa419ba221-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-91fa0249-7505-4030-9b8b-a3aa419ba221" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-91fa0249-7505-4030-9b8b-a3aa419ba221" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ababf7a-1a7c-45bf-aa38-d6ecd2433241]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:56 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 Nov 02 14:40:56 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:56 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221" returned: 0 in 0.426s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:56 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221 Nov 02 14:40:56 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:56 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-91fa0249-7505-4030-9b8b-a3aa419ba221" returned: 0 in 0.332s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-91fa0249-7505-4030-9b8b-a3aa419ba221" released by "delete_volume" :: held 0.819s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created reservations ['6916cf23-33d4-4636-acb7-f47f4af9c8ce', '47d2a339-b172-47fc-8f85-ed46ab20f96e', '4f9bfe95-2dd5-4852-b92c-a21535402721', '37ebdd2a-1a4e-4c68-ae84-5cbba5a3e026'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:56 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:56 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-b2187227-8d3e-4c65-8544-3177b65ed650-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-b2187227-8d3e-4c65-8544-3177b65ed650-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-b2187227-8d3e-4c65-8544-3177b65ed650" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-b2187227-8d3e-4c65-8544-3177b65ed650" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f0e2e-0154-4c7e-adcd-38395545953d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:57 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.360s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Deleted volume successfully. Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a16eb58d-83cd-4e61-a345-cd0909f9912a tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-91fa0249-7505-4030-9b8b-a3aa419ba221-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:57 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 Nov 02 14:40:57 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:57 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650" returned: 0 in 0.537s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:57 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650 Nov 02 14:40:57 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:58 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b2187227-8d3e-4c65-8544-3177b65ed650" returned: 0 in 0.323s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-b2187227-8d3e-4c65-8544-3177b65ed650" released by "delete_volume" :: held 0.938s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created reservations ['9b5f3274-f9af-4fd8-a1d2-9d5e5eb5e767', 'b5e35834-f29e-4b81-bde6-8972004df8a9', '1f59fb5b-c0f4-42f1-b310-102ad76ae715', '1397e4c7-e650-4881-8263-60a8f1bc123a'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:58 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:40:58 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:58 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.282s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:40:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Deleted volume successfully. Nov 02 14:40:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-584f722a-5bc3-4467-9142-e279dc419cae tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-b2187227-8d3e-4c65-8544-3177b65ed650-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-c45ba67e-1f06-4348-83c5-c3611683e533-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-c45ba67e-1f06-4348-83c5-c3611683e533-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-c45ba67e-1f06-4348-83c5-c3611683e533" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-c45ba67e-1f06-4348-83c5-c3611683e533" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb8825d-f864-4f77-acec-885962eb4a8b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:59 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 Nov 02 14:40:59 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:40:59 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533" returned: 0 in 0.386s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:40:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:40:59 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533 Nov 02 14:40:59 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-6df7c9ec-c019-41ae-8fa8-e1cbf614e74a tempest-ProjectAdminTests-1599369526 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8324928283691, 'free_capacity_gb': 1773.8324928283691, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86978) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 14:41:00 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c45ba67e-1f06-4348-83c5-c3611683e533" returned: 0 in 0.271s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-c45ba67e-1f06-4348-83c5-c3611683e533" released by "delete_volume" :: held 0.716s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created reservations ['832082f6-5720-4513-8c3b-4a082d710820', '5016d1b3-d5b4-44dd-a0e4-a1746befb001', 'c9be5134-ccba-4468-ada0-325d7ef54da2', '8ff4fa13-b9ac-4e84-88d3-3caaf50d6028'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:00 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:00 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-57a46eea-3db8-4a85-8a7a-c50741434987-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-57a46eea-3db8-4a85-8a7a-c50741434987-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-57a46eea-3db8-4a85-8a7a-c50741434987" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-57a46eea-3db8-4a85-8a7a-c50741434987" acquired by "delete_volume" :: waited 0.045s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Flow 'volume_create_manager' (b88f6859-d85d-432e-a58e-688b71460cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9ce00e-04c2-4018-ab1f-e94ac4ccf5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d66c226-4336-4054-a5e4-1a5c63390aa8]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:00 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9ce00e-04c2-4018-ab1f-e94ac4ccf5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-11132244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fafa661-dd01-476e-98fc-874f61dce425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8259268d2ee64a2a83c5202f31520f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:01Z,use_quota=True,user_id='f7db8b5f591d478e887cea6b4a1ba7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af64bca-9133-4c7f-b0e8-a4265919c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af64bca-9133-4c7f-b0e8-a4265919c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325e89bf-a358-40bb-bbf6-dd8c74581421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325e89bf-a358-40bb-bbf6-dd8c74581421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fafa661-dd01-476e-98fc-874f61dce425', 'volume_name': 'volume-4fafa661-dd01-476e-98fc-874f61dce425', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87758f0-5f3e-4a02-8e05-173c255a8345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87758f0-5f3e-4a02-8e05-173c255a8345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821264be-067a-49c6-af8d-a1a4b5c90aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:00 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Volume 4fafa661-dd01-476e-98fc-874f61dce425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fafa661-dd01-476e-98fc-874f61dce425', 'volume_size': 1} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-11132244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fafa661-dd01-476e-98fc-874f61dce425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8259268d2ee64a2a83c5202f31520f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:01Z,use_quota=True,user_id='f7db8b5f591d478e887cea6b4a1ba7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Creating volume 4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:01 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.592s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:01 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Deleted volume successfully. Nov 02 14:41:01 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 Nov 02 14:41:01 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:01 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 1073741824 Nov 02 14:41:01 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-db62ceca-7523-4636-97b6-d77067cbeb30 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-c45ba67e-1f06-4348-83c5-c3611683e533-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:01 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987" returned: 0 in 0.444s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:01 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987 Nov 02 14:41:01 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:01 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 1073741824" returned: 0 in 0.640s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:01 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-57a46eea-3db8-4a85-8a7a-c50741434987" returned: 0 in 0.364s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:01 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 Nov 02 14:41:01 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-57a46eea-3db8-4a85-8a7a-c50741434987" released by "delete_volume" :: held 0.917s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created reservations ['137b0372-a87d-40b4-892e-fff670b21bfb', '13651b04-ec05-4a52-926b-9fcd355cf7d8', 'cbc0342f-bac0-4d9e-a671-69e4ada2ad3c', 'cd3a6cc3-940a-4cdb-ac7c-e3de1bb0c60f'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-db5dc20a-b6fb-4a85-b90d-24514e17c847-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:01 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:01 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-db5dc20a-b6fb-4a85-b90d-24514e17c847-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-7a2f126e-a314-4305-821a-1dc509887f7e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:01 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425" returned: 0 in 0.280s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-7a2f126e-a314-4305-821a-1dc509887f7e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:01 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-db5dc20a-b6fb-4a85-b90d-24514e17c847" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821264be-067a-49c6-af8d-a1a4b5c90aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fafa661-dd01-476e-98fc-874f61dce425', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc73d6c-db45-4371-a4bc-280e28a2d323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-db5dc20a-b6fb-4a85-b90d-24514e17c847" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Deleting offline snapshot db5dc20a-b6fb-4a85-b90d-24514e17c847 of volume 7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] snapshot_file for this snap is: volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:02 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Volume volume-4fafa661-dd01-476e-98fc-874f61dce425 (4fafa661-dd01-476e-98fc-874f61dce425): created successfully Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dc73d6c-db45-4371-a4bc-280e28a2d323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Flow 'volume_create_manager' (b88f6859-d85d-432e-a58e-688b71460cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b42b08-e2a6-4f9d-abbf-1909c0cb022b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-764287ae-dde5-4728-a81d-2e9ac3f80672 tempest-VolumeDependencyTests-1462208988 None] Created volume successfully. Nov 02 14:41:02 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 Nov 02 14:41:02 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:02 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.319s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Deleted volume successfully. Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-90ef969e-0448-4e22-a5eb-9fe669ca482d tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-57a46eea-3db8-4a85-8a7a-c50741434987-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:02 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847" returned: 0 in 0.444s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a2f126e-a314-4305-821a-1dc509887f7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7ad9db-68f8-4c9c-b334-590391fedd04]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:02 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e Nov 02 14:41:02 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:03 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e" returned: 0 in 0.496s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:03 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 Nov 02 14:41:03 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Creating offline snapshot 5bd05e95-3482-44ac-bcb7-02decebee369 of volume 4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9abda2-cbec-4ddb-a03a-2ddfb5e8cab9]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:03 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 Nov 02 14:41:03 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:03 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847" returned: 0 in 0.456s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:03 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847 Nov 02 14:41:03 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:03 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425" returned: 0 in 0.618s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:03 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 1G Nov 02 14:41:03 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:03 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e.db5dc20a-b6fb-4a85-b90d-24514e17c847" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-db5dc20a-b6fb-4a85-b90d-24514e17c847" released by "_delete_snapshot" :: held 1.986s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-7a2f126e-a314-4305-821a-1dc509887f7e" released by "delete_snapshot" :: held 2.033s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created reservations ['dbc213cd-436c-4b90-bc87-51ddac3640dd', 'c1c2a39c-da9f-4396-b83d-0f2afee56a94', 'e30c6974-17a0-49b7-b16b-4cf634ea3ebc', '7bf6740a-aa06-43dc-a8fe-b15513cedae0'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Delete snapshot completed successfully. Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ac15b492-a233-4e95-a66a-21f7582c8f52 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-db5dc20a-b6fb-4a85-b90d-24514e17c847-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:04 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 1G" returned: 0 in 0.515s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fafa661-dd01-476e-98fc-874f61dce425 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:04 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fafa661-dd01-476e-98fc-874f61dce425 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 Nov 02 14:41:04 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:04 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fafa661-dd01-476e-98fc-874f61dce425 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369" returned: 0 in 0.325s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:04 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 is being set with open permissions: ugo+rw Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:04 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 Nov 02 14:41:04 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:04 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369" returned: 0 in 0.262s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:04 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.info Nov 02 14:41:04 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (a54aa255-85a4-493d-9f24-21a46466cefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f8eeeb-cdde-4405-8142-694412abf796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f8eeeb-cdde-4405-8142-694412abf796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102839404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a680f951-663f-40e1-b049-e636b2541a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:05Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d68669-1035-45d2-91b4-7c6dca08be36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d68669-1035-45d2-91b4-7c6dca08be36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648bb707-1df9-4171-9623-2c17dece37fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648bb707-1df9-4171-9623-2c17dece37fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a680f951-663f-40e1-b049-e636b2541a0e', 'volume_name': 'volume-a680f951-663f-40e1-b049-e636b2541a0e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9232ea75-db70-4b76-aac3-ca48a8219886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9232ea75-db70-4b76-aac3-ca48a8219886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5a10e9-f902-4901-8e7b-e008c9b4be1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:05 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Volume a680f951-663f-40e1-b049-e636b2541a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a680f951-663f-40e1-b049-e636b2541a0e', 'volume_size': 1} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-7a2f126e-a314-4305-821a-1dc509887f7e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:05 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.info" returned: 0 in 0.350s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:05 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.info is being set with open permissions: ugo+rw Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-7a2f126e-a314-4305-821a-1dc509887f7e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:05 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.info Nov 02 14:41:05 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "cinder-quobyte-7a2f126e-a314-4305-821a-1dc509887f7e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-7a2f126e-a314-4305-821a-1dc509887f7e" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf6bf6-c908-41bf-813a-8704984514ef]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:05 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e Nov 02 14:41:05 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:05 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.info" returned: 0 in 0.296s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1102839404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a680f951-663f-40e1-b049-e636b2541a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:05Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Creating volume a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:05 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:05 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e 1073741824 Nov 02 14:41:05 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:05 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9d76d310-2456-4d63-8bde-d00327fc5b4a tempest-VolumeDependencyTests-1462208988 None] Create snapshot completed successfully Nov 02 14:41:05 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:05 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e Nov 02 14:41:05 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:06 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e 1073741824" returned: 0 in 0.509s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:06 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7a2f126e-a314-4305-821a-1dc509887f7e" returned: 0 in 0.327s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-quobyte-7a2f126e-a314-4305-821a-1dc509887f7e" released by "delete_volume" :: held 0.836s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:06 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e Nov 02 14:41:06 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Created reservations ['2ef02e86-f66d-4ce5-9ef4-677def69f9da', '29360376-3f6a-4309-9601-b174a1f30958', '57ed8823-8926-4444-a9e7-352abd0faa94', '41c33eef-c9a6-41d8-8096-f928321a6192'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:06 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:06 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:06 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e" returned: 0 in 0.425s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5a10e9-f902-4901-8e7b-e008c9b4be1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a680f951-663f-40e1-b049-e636b2541a0e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f01bc4-7158-4ebd-bfa4-e38770df3181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:06 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Volume volume-a680f951-663f-40e1-b049-e636b2541a0e (a680f951-663f-40e1-b049-e636b2541a0e): created successfully Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f01bc4-7158-4ebd-bfa4-e38770df3181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (a54aa255-85a4-493d-9f24-21a46466cefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c8d401ba-5f68-4dd7-bc9f-98afcf3c995e tempest-ProjectReaderTests-1316139843 None] Created volume successfully. Nov 02 14:41:06 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.407s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Deleted volume successfully. Nov 02 14:41:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-249afabc-9e83-4f44-830c-9020d3b61a23 tempest-CreateVolumesFromSnapshotTest-1649204668 None] Lock "cinder-7a2f126e-a314-4305-821a-1dc509887f7e-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Flow 'volume_create_manager' (60e377d6-d249-42b7-9555-c5f37907ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fc01c5-0e2e-464b-ae8e-46533e68408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fc01c5-0e2e-464b-ae8e-46533e68408d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-840863230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a20842-5f77-4d43-98f4-a8bb50cb4c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8259268d2ee64a2a83c5202f31520f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5bd05e95-3482-44ac-bcb7-02decebee369,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:07Z,use_quota=True,user_id='f7db8b5f591d478e887cea6b4a1ba7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977b4aee-7486-4cc0-ad8d-9219ab93b2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977b4aee-7486-4cc0-ad8d-9219ab93b2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020fc749-0de7-41e8-8dd4-78fb93f2fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020fc749-0de7-41e8-8dd4-78fb93f2fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1a20842-5f77-4d43-98f4-a8bb50cb4c7d', 'volume_name': 'volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d', 'volume_size': 1, 'snapshot_id': '5bd05e95-3482-44ac-bcb7-02decebee369'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd95041-9c71-441b-ac52-491195e07e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd95041-9c71-441b-ac52-491195e07e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01c1b1f-d03f-4d84-9b94-402d37b4128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:07 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Volume d1a20842-5f77-4d43-98f4-a8bb50cb4c7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d', 'volume_size': 1, 'snapshot_id': '5bd05e95-3482-44ac-bcb7-02decebee369'} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-quobyte-5bd05e95-3482-44ac-bcb7-02decebee369-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-5bd05e95-3482-44ac-bcb7-02decebee369-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Creating volume d1a20842-5f77-4d43-98f4-a8bb50cb4c7d from snapshot 5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-quobyte-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] snapshot: 5bd05e95-3482-44ac-bcb7-02decebee369, volume: d1a20842-5f77-4d43-98f4-a8bb50cb4c7d, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d99021-bcf2-4ff4-a1ae-dd6af6ccae04]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:07 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 Nov 02 14:41:07 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:07 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369" returned: 0 in 0.485s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fafa661-dd01-476e-98fc-874f61dce425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ee3150-477a-4f44-8b7b-50f142ccdc00]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:07 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 Nov 02 14:41:07 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:08 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425" returned: 0 in 0.430s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:41:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:41:08 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:41:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:08 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d Nov 02 14:41:08 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Flow 'volume_create_manager' (3ae01ea5-69ae-45e1-abe9-86d160cd951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c2cbde-1f11-4fc6-8f56-b65aca3c264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c2cbde-1f11-4fc6-8f56-b65aca3c264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9f0dcc-e70f-44aa-a77a-144d98be0b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953aa21a9e644c35b0736b6a64bb16e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:15Z,use_quota=True,user_id='dd2f1dad8e43497b97481607f4790eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239f54d8-6ace-45b5-a391-21357a71c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239f54d8-6ace-45b5-a391-21357a71c506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e0e968-3554-4d1a-8f41-09b4fc8dd387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:14 devstack cinder-volume[86978]: DEBUG cinder.image.glance [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Creating Keystone auth plugin from conf {{(pid=86978) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e0e968-3554-4d1a-8f41-09b4fc8dd387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d9f0dcc-e70f-44aa-a77a-144d98be0b08', 'volume_name': 'volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08', 'volume_size': 1, 'image_id': '000a4b11-1971-408d-8e3d-2b6b7524a971', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000a4b11-1971-408d-8e3d-2b6b7524a971', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3a51a50989befbc64f46dbd6455652e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '953aa21a9e644c35b0736b6a64bb16e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf29fe323b7ecab77a34c5a89066f4034922089909218684ff1233dca441f893450e4940947b4bb48273f17e1ff8340ed58a294c054345fbb46a08cfba014dd9', 'id': '000a4b11-1971-408d-8e3d-2b6b7524a971', 'created_at': datetime.datetime(2026, 11, 2, 13, 41, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 41, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000a4b11-1971-408d-8e3d-2b6b7524a971/file', 'properties': {}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9714f9-0404-4955-ace5-e2309907390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9714f9-0404-4955-ace5-e2309907390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d78750d-d980-4765-a409-991d87536fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Volume 3d9f0dcc-e70f-44aa-a77a-144d98be0b08: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08', 'volume_size': 1, 'image_id': '000a4b11-1971-408d-8e3d-2b6b7524a971', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000a4b11-1971-408d-8e3d-2b6b7524a971', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3a51a50989befbc64f46dbd6455652e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '953aa21a9e644c35b0736b6a64bb16e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf29fe323b7ecab77a34c5a89066f4034922089909218684ff1233dca441f893450e4940947b4bb48273f17e1ff8340ed58a294c054345fbb46a08cfba014dd9', 'id': '000a4b11-1971-408d-8e3d-2b6b7524a971', 'created_at': datetime.datetime(2026, 11, 2, 13, 41, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 41, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000a4b11-1971-408d-8e3d-2b6b7524a971/file', 'properties': {}}, 'image_service': } Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Trying to clone 3d9f0dcc-e70f-44aa-a77a-144d98be0b08 from image 000a4b11-1971-408d-8e3d-2b6b7524a971 at location (None, [{'url': 'file:///opt/stack/data/glance/images/000a4b11-1971-408d-8e3d-2b6b7524a971', 'metadata': {}}]). {{(pid=86978) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 14:41:15 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Image download 0.00 MB at 0.00 MB/s Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b2644-6b8d-4a9a-88cf-3cbe728e568e]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:16 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD Nov 02 14:41:16 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:16 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:16 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" returned: 0 in 8.088s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425, size 1024.00 MB, duration 8.09 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:41:16 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Converted 1024.00 MB image at 126.59 MB/s Nov 02 14:41:16 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d is being set with open permissions: ugo+rw Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:16 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d Nov 02 14:41:16 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:16 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD Nov 02 14:41:16 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:16 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" returned: 0 in 0.242s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" released by "_copy_volume_from_snapshot" :: held 9.366s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:16 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Temporary image 000a4b11-1971-408d-8e3d-2b6b7524a971 is fetched for user dd2f1dad8e43497b97481607f4790eed. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-5bd05e95-3482-44ac-bcb7-02decebee369-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" released by "_create_volume_from_snapshot" :: held 9.454s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.476s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.981s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Creating offline snapshot 4733c5eb-7df7-4c0e-ba28-a6264fa12ccd of volume a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c01c1b1f-d03f-4d84-9b94-402d37b4128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d', 'volume_size': 1, 'snapshot_id': '5bd05e95-3482-44ac-bcb7-02decebee369'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ad2422-3181-4361-b520-818094981505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c628d52-7a54-4569-a43c-ddbf8c4d7432]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:16 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Volume volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d (d1a20842-5f77-4d43-98f4-a8bb50cb4c7d): created successfully Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ad2422-3181-4361-b520-818094981505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Flow 'volume_create_manager' (60e377d6-d249-42b7-9555-c5f37907ac08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e289524-2595-48b8-b78c-6dc5e3112261]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-58bdc5ee-f2f4-474c-9c89-546bc8282f57 tempest-VolumeDependencyTests-1462208988 None] Created volume successfully. Nov 02 14:41:16 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e Nov 02 14:41:16 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:16 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD Nov 02 14:41:16 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-5bd05e95-3482-44ac-bcb7-02decebee369-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-5bd05e95-3482-44ac-bcb7-02decebee369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-quobyte-4fafa661-dd01-476e-98fc-874f61dce425" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:17 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:17 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e" returned: 0 in 0.474s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-4fafa661-dd01-476e-98fc-874f61dce425" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-quobyte-5bd05e95-3482-44ac-bcb7-02decebee369" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:17 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd 1G Nov 02 14:41:17 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-5bd05e95-3482-44ac-bcb7-02decebee369" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Deleting offline snapshot 5bd05e95-3482-44ac-bcb7-02decebee369 of volume 4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] snapshot_file for this snap is: volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09d5022-2e6b-412c-bd6a-8bedb2ae5022]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:17 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD Nov 02 14:41:17 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:17 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 Nov 02 14:41:17 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:17 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:17 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd 1G" returned: 0 in 0.495s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a680f951-663f-40e1-b049-e636b2541a0e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:17 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a680f951-663f-40e1-b049-e636b2541a0e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd Nov 02 14:41:17 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:17 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369" returned: 0 in 0.467s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fafa661-dd01-476e-98fc-874f61dce425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6724c006-72f6-4876-bc33-f4558dafc5e2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:17 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 Nov 02 14:41:17 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:17 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a680f951-663f-40e1-b049-e636b2541a0e -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" returned: 0 in 0.314s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:17 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd is being set with open permissions: ugo+rw Nov 02 14:41:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:17 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd Nov 02 14:41:17 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:18 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:18 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.info Nov 02 14:41:18 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:18 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425" returned: 0 in 0.605s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:18 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 Nov 02 14:41:18 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:18 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.info" returned: 0 in 0.345s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:18 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.info is being set with open permissions: ugo+rw Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:18 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.info Nov 02 14:41:18 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:18 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369" returned: 0 in 0.443s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:18 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369 Nov 02 14:41:18 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:18 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.info" returned: 0 in 0.291s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d9f0dcc-e70f-44aa-a77a-144d98be0b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953aa21a9e644c35b0736b6a64bb16e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:15Z,use_quota=True,user_id='dd2f1dad8e43497b97481607f4790eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Creating volume 3d9f0dcc-e70f-44aa-a77a-144d98be0b08 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:18 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:19 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 1073741824 Nov 02 14:41:19 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-92369fa8-89f6-4438-bb4a-3402264ac929 tempest-ProjectReaderTests-1316139843 None] Create snapshot completed successfully Nov 02 14:41:19 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425.5bd05e95-3482-44ac-bcb7-02decebee369" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-5bd05e95-3482-44ac-bcb7-02decebee369" released by "_delete_snapshot" :: held 1.913s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-4fafa661-dd01-476e-98fc-874f61dce425" released by "delete_snapshot" :: held 1.975s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Created reservations ['f8049021-7cdb-47fc-b789-4b3b60bb3abe', '64f5afab-e4b0-425a-bc3c-4166af63303f', '4a6f0a6d-ec04-414b-8f6d-1de8e65c4d95', '55971f0d-759b-4aec-afef-0ffe81ce5ab4'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Delete snapshot completed successfully. Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-ab47a19b-6c84-469f-9d64-2c06b729daf0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-5bd05e95-3482-44ac-bcb7-02decebee369-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-4fafa661-dd01-476e-98fc-874f61dce425-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-4fafa661-dd01-476e-98fc-874f61dce425-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-quobyte-4fafa661-dd01-476e-98fc-874f61dce425" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-4fafa661-dd01-476e-98fc-874f61dce425" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e22979-c08e-4870-8279-19564379c3e5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:19 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 1073741824" returned: 0 in 0.623s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:19 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 Nov 02 14:41:19 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:19 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 Nov 02 14:41:19 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-4733c5eb-7df7-4c0e-ba28-a6264fa12ccd-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-4733c5eb-7df7-4c0e-ba28-a6264fa12ccd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-a680f951-663f-40e1-b049-e636b2541a0e" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-a680f951-663f-40e1-b049-e636b2541a0e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Deleting offline snapshot 4733c5eb-7df7-4c0e-ba28-a6264fa12ccd of volume a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] snapshot_file for this snap is: volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4609fba-2b49-4155-a67b-725bdac8f1e4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:19 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08" returned: 0 in 0.324s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:19 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425" returned: 0 in 0.510s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:20 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd Nov 02 14:41:20 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Attempting download of 000a4b11-1971-408d-8e3d-2b6b7524a971 ((None, [{'url': 'file:///opt/stack/data/glance/images/000a4b11-1971-408d-8e3d-2b6b7524a971', 'metadata': {}}])) to volume 3d9f0dcc-e70f-44aa-a77a-144d98be0b08. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 14:41:20 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425 Nov 02 14:41:20 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff403f6e-5015-44fa-9a77-e3e5d12992d1]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000a4b11-1971-408d-8e3d-2b6b7524a971_37fhs2fx {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:20 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000a4b11-1971-408d-8e3d-2b6b7524a971_37fhs2fx Nov 02 14:41:20 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:20 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4fafa661-dd01-476e-98fc-874f61dce425" returned: 0 in 0.283s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-4fafa661-dd01-476e-98fc-874f61dce425" released by "delete_volume" :: held 0.875s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:20 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" returned: 0 in 0.441s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a680f951-663f-40e1-b049-e636b2541a0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9391fe56-6014-4721-b69f-350d0c9bbe3a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Created reservations ['3c5a20ff-24ff-464a-85b3-577c48a4867d', 'c5f771f3-3d42-44f8-8d6e-03d45da94b21', '4f59a33b-6317-4ccd-b5e6-167b1b1d29bb', 'e7ad7b4b-3d7c-421f-ad76-03282989ac05'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:20 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:20 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e Nov 02 14:41:20 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000a4b11-1971-408d-8e3d-2b6b7524a971_37fhs2fx" returned: 0 in 0.443s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000a4b11-1971-408d-8e3d-2b6b7524a971_37fhs2fx {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:20 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:20 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:20 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000a4b11-1971-408d-8e3d-2b6b7524a971_37fhs2fx Nov 02 14:41:20 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:20 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:20 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Deleted volume successfully. Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-43a668c0-8290-4c56-b132-27c8fc2b01d0 tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-4fafa661-dd01-476e-98fc-874f61dce425-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:20 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e" returned: 0 in 0.507s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:20 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:20 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd Nov 02 14:41:20 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000a4b11-1971-408d-8e3d-2b6b7524a971_37fhs2fx" returned: 1 in 0.361s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000a4b11-1971-408d-8e3d-2b6b7524a971_37fhs2fx' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e8eb02-8844-4447-b116-aa1767a6dbcb]: (4, 'raw') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:21 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD Nov 02 14:41:21 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:21 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:21 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:21 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd Nov 02 14:41:21 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:21 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD Nov 02 14:41:21 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:21 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e.4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-4733c5eb-7df7-4c0e-ba28-a6264fa12ccd" released by "_delete_snapshot" :: held 1.753s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-a680f951-663f-40e1-b049-e636b2541a0e" released by "delete_snapshot" :: held 1.807s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:21 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] 000a4b11-1971-408d-8e3d-2b6b7524a971 was raw, converting to qcow2 {{(pid=86978) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:21 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 Nov 02 14:41:21 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "cinder-quobyte-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Created reservations ['21364cd1-6ab4-41c9-9af3-5d1f5b9ef8cc', 'def0cc34-ef7a-4794-a4e7-0f78046875b8', '4402475d-0919-417c-8294-64e2467017aa', 'dd3b255b-df56-4480-99a1-d11d5d9acf10'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea934624-8310-44aa-8ac7-ad6820eb2c12]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Delete snapshot completed successfully. Nov 02 14:41:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b231890d-d2b4-4ecd-a5ed-dd5406189086 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-4733c5eb-7df7-4c0e-ba28-a6264fa12ccd-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:21 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d Nov 02 14:41:21 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-a680f951-663f-40e1-b049-e636b2541a0e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-a680f951-663f-40e1-b049-e636b2541a0e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-a680f951-663f-40e1-b049-e636b2541a0e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-a680f951-663f-40e1-b049-e636b2541a0e" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae79b41-0391-400c-bf7d-f4e7a76ef6b7]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:22 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08" returned: 0 in 0.605s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_000a4b11-1971-408d-8e3d-2b6b7524a971_m3xpcj1jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:41:22 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:22 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e Nov 02 14:41:22 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:22 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 1G Nov 02 14:41:22 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:22 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" returned: 0 in 0.564s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:22 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d Nov 02 14:41:22 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:22 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e" returned: 0 in 0.441s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:22 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e Nov 02 14:41:22 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:22 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" returned: 0 in 0.329s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-quobyte-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d" released by "delete_volume" :: held 0.959s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:22 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 1G" returned: 0 in 0.424s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Downloaded image 000a4b11-1971-408d-8e3d-2b6b7524a971 ((None, [{'url': 'file:///opt/stack/data/glance/images/000a4b11-1971-408d-8e3d-2b6b7524a971', 'metadata': {}}])) to volume 3d9f0dcc-e70f-44aa-a77a-144d98be0b08 successfully. {{(pid=86978) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Temporary image 000a4b11-1971-408d-8e3d-2b6b7524a971 for user dd2f1dad8e43497b97481607f4790eed is deleted. {{(pid=86978) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.volume_utils [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Marking volume 3d9f0dcc-e70f-44aa-a77a-144d98be0b08 as bootable. {{(pid=86978) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Copying metadata from image 000a4b11-1971-408d-8e3d-2b6b7524a971 to 3d9f0dcc-e70f-44aa-a77a-144d98be0b08. {{(pid=86978) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Creating volume glance metadata for volume 3d9f0dcc-e70f-44aa-a77a-144d98be0b08 backed by image 000a4b11-1971-408d-8e3d-2b6b7524a971 with: {'image_id': '000a4b11-1971-408d-8e3d-2b6b7524a971', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e3a51a50989befbc64f46dbd6455652e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86978) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Created reservations ['5b583bde-25a2-4fbb-8bff-ceb6d35412eb', '36c7b54b-521b-466b-8c4e-9c3965827e12', 'ff7ddf60-38ac-4356-95fb-fa3ed1ed86d4', '77aa28f1-bda6-4ae0-90bd-f36ba35e59d3'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d78750d-d980-4765-a409-991d87536fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08', 'volume_size': 1, 'image_id': '000a4b11-1971-408d-8e3d-2b6b7524a971', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000a4b11-1971-408d-8e3d-2b6b7524a971', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3a51a50989befbc64f46dbd6455652e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '953aa21a9e644c35b0736b6a64bb16e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf29fe323b7ecab77a34c5a89066f4034922089909218684ff1233dca441f893450e4940947b4bb48273f17e1ff8340ed58a294c054345fbb46a08cfba014dd9', 'id': '000a4b11-1971-408d-8e3d-2b6b7524a971', 'created_at': datetime.datetime(2026, 11, 2, 13, 41, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 13, 41, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000a4b11-1971-408d-8e3d-2b6b7524a971/file', 'properties': {}}, 'image_service': }' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc89c790-5f53-4b04-aa61-0abb99d405a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:22 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Volume volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 (3d9f0dcc-e70f-44aa-a77a-144d98be0b08): created successfully Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc89c790-5f53-4b04-aa61-0abb99d405a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Flow 'volume_create_manager' (3ae01ea5-69ae-45e1-abe9-86d160cd951f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:22 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a680f951-663f-40e1-b049-e636b2541a0e" returned: 0 in 0.308s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:22 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-a680f951-663f-40e1-b049-e636b2541a0e" released by "delete_volume" :: held 0.853s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-380d4337-7f0e-448f-99ad-a5e47b4d1519 tempest-VolumeImageDependencyTests-334361401 None] Created volume successfully. Nov 02 14:41:22 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:22 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Created reservations ['d4ca8829-3b13-4a3e-8de3-e899b11d1b53', '9321a1a2-3a73-4400-bcfc-96af13117de7', '6b5ba799-f5d0-464c-a6ff-d4346469815a', '440b3c00-77af-4f95-a4d2-38a3f3197d41'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:23 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:23 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:23 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.295s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Deleted volume successfully. Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d88ba520-ead5-4b56-8541-c1eb2d968a3f tempest-VolumeDependencyTests-1462208988 None] Lock "cinder-d1a20842-5f77-4d43-98f4-a8bb50cb4c7d-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:23 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.312s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:23 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Deleted volume successfully. Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Acquiring lock "cinder-3d9f0dcc-e70f-44aa-a77a-144d98be0b08-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Lock "cinder-3d9f0dcc-e70f-44aa-a77a-144d98be0b08-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-4e8335ec-7280-46a9-869a-284da93c1a91 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-a680f951-663f-40e1-b049-e636b2541a0e-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Acquiring lock "cinder-quobyte-3d9f0dcc-e70f-44aa-a77a-144d98be0b08" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Lock "cinder-quobyte-3d9f0dcc-e70f-44aa-a77a-144d98be0b08" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c96b7-826c-416c-9b38-f32c2763f9f9]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:23 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 Nov 02 14:41:23 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (94a2267b-bd33-4042-be76-2041ca001023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a4aef6-6ea2-41e2-afc6-265222dcf063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a4aef6-6ea2-41e2-afc6-265222dcf063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317609673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f64d427-74f5-4e56-aa04-a164dc627782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:24Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ace491a-d958-4a1e-8178-2546ba1abb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ace491a-d958-4a1e-8178-2546ba1abb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e97b1-5bac-47e6-b93e-b5651872df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952e97b1-5bac-47e6-b93e-b5651872df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f64d427-74f5-4e56-aa04-a164dc627782', 'volume_name': 'volume-4f64d427-74f5-4e56-aa04-a164dc627782', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b87039-8bbb-4f78-b153-eea0f118f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b87039-8bbb-4f78-b153-eea0f118f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2207976-6add-43c8-a5f9-8d54b6f3ffd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:23 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Volume 4f64d427-74f5-4e56-aa04-a164dc627782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f64d427-74f5-4e56-aa04-a164dc627782', 'volume_size': 1} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-317609673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f64d427-74f5-4e56-aa04-a164dc627782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:24Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Creating volume 4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:23 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:23 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 1073741824 Nov 02 14:41:23 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:24 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08" returned: 0 in 0.459s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:24 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08 Nov 02 14:41:24 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:24 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3d9f0dcc-e70f-44aa-a77a-144d98be0b08" returned: 0 in 0.313s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Lock "cinder-quobyte-3d9f0dcc-e70f-44aa-a77a-144d98be0b08" released by "delete_volume" :: held 0.831s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Created reservations ['65aa4dd6-c017-40ce-9652-467a3e5c89dd', '3dd3affb-4684-4594-ba60-c809845560f6', 'bf3363ef-bcb0-40f8-87b5-35fe2800b51f', 'd395a22a-87bf-40a6-8954-425b237ca104'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:24 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 1073741824" returned: 0 in 0.587s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:24 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 Nov 02 14:41:24 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:24 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:24 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:25 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782" returned: 0 in 0.486s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2207976-6add-43c8-a5f9-8d54b6f3ffd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f64d427-74f5-4e56-aa04-a164dc627782', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a50998-6811-4aac-be0a-22ee6165451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:25 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Volume volume-4f64d427-74f5-4e56-aa04-a164dc627782 (4f64d427-74f5-4e56-aa04-a164dc627782): created successfully Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a50998-6811-4aac-be0a-22ee6165451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (94a2267b-bd33-4042-be76-2041ca001023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:25 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.489s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Deleted volume successfully. Nov 02 14:41:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-89829d5c-91e4-4ffa-b49d-f46046e80c5a tempest-ProjectReaderTests-1316139843 None] Created volume successfully. Nov 02 14:41:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-10fceddf-a786-45a6-a72e-dff561756d1a tempest-VolumeImageDependencyTests-334361401 None] Lock "cinder-3d9f0dcc-e70f-44aa-a77a-144d98be0b08-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Creating offline snapshot c9cce941-8d1b-4a31-b83a-d51ea615c4c1 of volume 4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:26 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[251ce6cd-504f-4b43-8e12-3728e2727755]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:26 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 Nov 02 14:41:26 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:26 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782" returned: 0 in 0.474s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:26 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 1G Nov 02 14:41:26 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:27 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 1G" returned: 0 in 0.493s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f64d427-74f5-4e56-aa04-a164dc627782 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:27 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f64d427-74f5-4e56-aa04-a164dc627782 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 Nov 02 14:41:27 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:27 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f64d427-74f5-4e56-aa04-a164dc627782 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1" returned: 0 in 0.403s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:27 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 is being set with open permissions: ugo+rw Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:27 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 Nov 02 14:41:27 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Flow 'volume_create_manager' (e9b25c09-8f7d-4b0a-8f18-6b3c1b7bf22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a473bf98-f40a-447d-95f6-2caa31fb55b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:27 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a473bf98-f40a-447d-95f6-2caa31fb55b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943b9141da243e6b7a55b0ff017f8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:28Z,use_quota=True,user_id='fb88935a3e41471ea5953d76051f89cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e42511b-657f-4980-9267-699ec43c4932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e42511b-657f-4980-9267-699ec43c4932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57cb761-bef2-4078-99fc-076e8b3c334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57cb761-bef2-4078-99fc-076e8b3c334e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3', 'volume_name': 'volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f07e512-9e97-4578-85df-8dba93d59a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f07e512-9e97-4578-85df-8dba93d59a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07f6623-d652-4da1-90c7-23b9e3018703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Volume 3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3', 'volume_size': 1} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1" returned: 0 in 0.368s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:28 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.info Nov 02 14:41:28 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:28 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.info" returned: 0 in 0.297s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:28 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.info is being set with open permissions: ugo+rw Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:28 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.info Nov 02 14:41:28 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:28 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.info" returned: 0 in 0.343s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943b9141da243e6b7a55b0ff017f8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:28Z,use_quota=True,user_id='fb88935a3e41471ea5953d76051f89cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Creating volume 3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:28 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:28 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 1073741824 Nov 02 14:41:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8307e9f7-8edd-49aa-a7dc-4f1ff4e6359f tempest-ProjectReaderTests-1316139843 None] Create snapshot completed successfully Nov 02 14:41:28 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:29 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 1073741824" returned: 0 in 0.558s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:29 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 Nov 02 14:41:29 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-c9cce941-8d1b-4a31-b83a-d51ea615c4c1-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-c9cce941-8d1b-4a31-b83a-d51ea615c4c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-4f64d427-74f5-4e56-aa04-a164dc627782" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-4f64d427-74f5-4e56-aa04-a164dc627782" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-c9cce941-8d1b-4a31-b83a-d51ea615c4c1" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-c9cce941-8d1b-4a31-b83a-d51ea615c4c1" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Deleting offline snapshot c9cce941-8d1b-4a31-b83a-d51ea615c4c1 of volume 4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] snapshot_file for this snap is: volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea8548-9df5-4fd0-a8a5-bf8e50843496]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:29 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3" returned: 0 in 0.363s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07f6623-d652-4da1-90c7-23b9e3018703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e683f354-0d67-4b4e-ae16-fbed7d2bccfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:29 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Volume volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 (3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3): created successfully Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e683f354-0d67-4b4e-ae16-fbed7d2bccfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Flow 'volume_create_manager' (e9b25c09-8f7d-4b0a-8f18-6b3c1b7bf22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:29 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 Nov 02 14:41:29 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d07e2b24-2488-4e72-ab3a-e09dcb5af79d tempest-CinderUnicodeTest-2146847792 None] Created volume successfully. Nov 02 14:41:30 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1" returned: 0 in 0.583s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f64d427-74f5-4e56-aa04-a164dc627782(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[00618431-e59a-4c55-af92-9e340b9b129f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:30 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 Nov 02 14:41:30 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=262,cinder:SELECT=191,cinder:INSERT=75,cinder:DELETE=26 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=207,cinder:UPDATE=286,cinder:INSERT=72,cinder:DELETE=24 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Flow 'volume_create_manager' (73361093-7ec3-472c-94ef-0e938ccd06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5def7e-cac7-4dab-92e5-1ed712b9d5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5def7e-cac7-4dab-92e5-1ed712b9d5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1745000165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609cc031-3f65-4cb6-8699-0befef49f609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943b9141da243e6b7a55b0ff017f8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:31Z,use_quota=True,user_id='fb88935a3e41471ea5953d76051f89cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13af3b86-b815-4ffb-8a82-739e587fa51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13af3b86-b815-4ffb-8a82-739e587fa51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09ecd99-5169-4632-b159-473b79842c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09ecd99-5169-4632-b159-473b79842c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609cc031-3f65-4cb6-8699-0befef49f609', 'volume_name': 'volume-609cc031-3f65-4cb6-8699-0befef49f609', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:30 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2710a9b-64f0-4378-9e9c-8da5d48500cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2710a9b-64f0-4378-9e9c-8da5d48500cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9a0151-6faf-4365-94c7-359e2d78ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:30 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Volume 609cc031-3f65-4cb6-8699-0befef49f609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609cc031-3f65-4cb6-8699-0befef49f609', 'volume_size': 1} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1745000165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609cc031-3f65-4cb6-8699-0befef49f609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6943b9141da243e6b7a55b0ff017f8b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:31Z,use_quota=True,user_id='fb88935a3e41471ea5953d76051f89cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Creating volume 609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:30 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782" returned: 0 in 0.695s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:30 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 1073741824 Nov 02 14:41:30 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:30 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 Nov 02 14:41:30 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:31 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1" returned: 0 in 0.437s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:31 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1 Nov 02 14:41:31 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:31 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 1073741824" returned: 0 in 0.590s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:31 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 Nov 02 14:41:31 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:31 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782.c9cce941-8d1b-4a31-b83a-d51ea615c4c1" returned: 0 in 0.362s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-c9cce941-8d1b-4a31-b83a-d51ea615c4c1" released by "_delete_snapshot" :: held 2.269s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-4f64d427-74f5-4e56-aa04-a164dc627782" released by "delete_snapshot" :: held 2.314s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:31 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609" returned: 0 in 0.337s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9a0151-6faf-4365-94c7-359e2d78ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609cc031-3f65-4cb6-8699-0befef49f609', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c853b28-c12e-4944-83a1-026348b16992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:31 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Volume volume-609cc031-3f65-4cb6-8699-0befef49f609 (609cc031-3f65-4cb6-8699-0befef49f609): created successfully Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c853b28-c12e-4944-83a1-026348b16992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Flow 'volume_create_manager' (73361093-7ec3-472c-94ef-0e938ccd06fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:31 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Created reservations ['444d2b29-3055-468d-bcfc-db6ac3eae800', '9a6b13f0-2fc0-4327-a3c9-86a60c93704a', '988b075f-6fdc-442b-be3f-173db7061f1f', '32990c4f-02d6-4d6b-a81a-0fc4b53063ba'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cb85aace-fc89-42da-b3a3-953e9c43f2a2 tempest-CinderUnicodeTest-2146847792 None] Created volume successfully. Nov 02 14:41:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Delete snapshot completed successfully. Nov 02 14:41:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-13729ed9-e8c8-4e56-9002-cda17d4fcc62 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-c9cce941-8d1b-4a31-b83a-d51ea615c4c1-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-4f64d427-74f5-4e56-aa04-a164dc627782-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Lock "cinder-4f64d427-74f5-4e56-aa04-a164dc627782-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-4f64d427-74f5-4e56-aa04-a164dc627782" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-4f64d427-74f5-4e56-aa04-a164dc627782" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:32 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6b9a57-8f57-4bb0-b2c6-155cc0157089]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:33 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 Nov 02 14:41:33 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Creating offline snapshot 3626a2e1-79e4-42b6-bb82-2a58be4a07b9 of volume 609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3ce344-5460-4440-b299-afacc350cc6d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:33 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 Nov 02 14:41:33 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:33 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782" returned: 0 in 0.612s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:33 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782 Nov 02 14:41:33 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:33 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609" returned: 0 in 0.557s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:33 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 1G Nov 02 14:41:33 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:33 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-4f64d427-74f5-4e56-aa04-a164dc627782" returned: 0 in 0.461s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-4f64d427-74f5-4e56-aa04-a164dc627782" released by "delete_volume" :: held 1.177s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Created reservations ['8d27924b-21be-4058-ab4b-e4c2782092c9', '38c9f4f5-3e8a-4c3a-9e86-fc3c1088776a', '40a8c93e-3286-408b-9750-2cfeec12e593', 'afd307b2-0dc2-497e-bb55-473e5eab42fe'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:34 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:34 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:34 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 1G" returned: 0 in 0.788s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-609cc031-3f65-4cb6-8699-0befef49f609 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:34 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-609cc031-3f65-4cb6-8699-0befef49f609 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 Nov 02 14:41:34 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:34 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.423s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Deleted volume successfully. Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1b397436-ef54-4750-ba59-0b6153cba96d tempest-ProjectReaderTests-1316139843 None] Lock "cinder-4f64d427-74f5-4e56-aa04-a164dc627782-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:34 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-609cc031-3f65-4cb6-8699-0befef49f609 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:34 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 is being set with open permissions: ugo+rw Nov 02 14:41:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:34 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 Nov 02 14:41:34 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:35 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9" returned: 0 in 0.313s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:35 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.info Nov 02 14:41:35 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:35 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.info" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:35 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.info is being set with open permissions: ugo+rw Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:35 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.info Nov 02 14:41:35 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (bcb972ec-5e34-4a54-abf0-8ef5bb0087d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ccaf11-ed95-406f-b97a-3d64d03d918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ccaf11-ed95-406f-b97a-3d64d03d918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260484257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d3769f-0d49-442e-af51-da3e1c379946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:36Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1bb928-1497-4380-9111-3b1af7d9715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1bb928-1497-4380-9111-3b1af7d9715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca5be01-0f27-49a4-a05e-97e84f291aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca5be01-0f27-49a4-a05e-97e84f291aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d3769f-0d49-442e-af51-da3e1c379946', 'volume_name': 'volume-65d3769f-0d49-442e-af51-da3e1c379946', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19601859-0a40-41a2-a135-beb1e346af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19601859-0a40-41a2-a135-beb1e346af48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092a3bff-0f67-45f0-a6ac-6187b07560cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Volume 65d3769f-0d49-442e-af51-da3e1c379946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d3769f-0d49-442e-af51-da3e1c379946', 'volume_size': 1} Nov 02 14:41:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:36 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.info" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260484257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d3769f-0d49-442e-af51-da3e1c379946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:36Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Creating volume 65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:36 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:36 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 1073741824 Nov 02 14:41:36 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (d6435fae-1f5f-4e33-a48e-84c418ae9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819fff5c-a9f5-40cf-9499-3dde9c3642f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:36 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-02fd34e6-0f30-46d7-aae7-c9bc97146ab9 tempest-CinderUnicodeTest-2146847792 None] Create snapshot completed successfully Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819fff5c-a9f5-40cf-9499-3dde9c3642f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490514768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbcfcf7-d17d-4e69-ab5f-3b356b4297f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:36Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9926790b-9bb6-472a-967b-a32a8e28665a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9926790b-9bb6-472a-967b-a32a8e28665a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdd92dd-2875-4c1a-b3b4-92b738a61eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdd92dd-2875-4c1a-b3b4-92b738a61eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abbcfcf7-d17d-4e69-ab5f-3b356b4297f6', 'volume_name': 'volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687ff272-33ca-4b4d-85dc-e1acb4724aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687ff272-33ca-4b4d-85dc-e1acb4724aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68695490-f233-413a-9c45-da9e6ced5a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Volume abbcfcf7-d17d-4e69-ab5f-3b356b4297f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6', 'volume_size': 1} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:36 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 1073741824" returned: 0 in 0.569s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "cinder-3626a2e1-79e4-42b6-bb82-2a58be4a07b9-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:36 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 Nov 02 14:41:36 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-3626a2e1-79e4-42b6-bb82-2a58be4a07b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "cinder-quobyte-609cc031-3f65-4cb6-8699-0befef49f609" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-609cc031-3f65-4cb6-8699-0befef49f609" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "cinder-quobyte-3626a2e1-79e4-42b6-bb82-2a58be4a07b9" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-3626a2e1-79e4-42b6-bb82-2a58be4a07b9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Deleting offline snapshot 3626a2e1-79e4-42b6-bb82-2a58be4a07b9 of volume 609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] snapshot_file for this snap is: volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[87912cbe-d39e-455e-bb55-dc5390e79f17]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:36 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 Nov 02 14:41:36 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:37 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946" returned: 0 in 0.359s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-490514768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbcfcf7-d17d-4e69-ab5f-3b356b4297f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:36Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Creating volume abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:37 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092a3bff-0f67-45f0-a6ac-6187b07560cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d3769f-0d49-442e-af51-da3e1c379946', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84037e35-75da-4af3-8472-5d572bf3dab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:37 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 1073741824 Nov 02 14:41:37 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:37 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Volume volume-65d3769f-0d49-442e-af51-da3e1c379946 (65d3769f-0d49-442e-af51-da3e1c379946): created successfully Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84037e35-75da-4af3-8472-5d572bf3dab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (bcb972ec-5e34-4a54-abf0-8ef5bb0087d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1f07f931-8903-4f15-bc97-8eb310259814 tempest-ProjectReaderTests-1316139843 None] Created volume successfully. Nov 02 14:41:37 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9" returned: 0 in 0.464s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-609cc031-3f65-4cb6-8699-0befef49f609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4354725a-b782-425e-8d38-b95e781d467a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:37 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 Nov 02 14:41:37 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:37 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 1073741824" returned: 0 in 0.556s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:37 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 Nov 02 14:41:37 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:37 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609" returned: 0 in 0.478s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:37 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 Nov 02 14:41:37 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:38 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" returned: 0 in 0.343s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68695490-f233-413a-9c45-da9e6ced5a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f354f9c-bb98-44a1-8b94-f169f2577190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:38 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Volume volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 (abbcfcf7-d17d-4e69-ab5f-3b356b4297f6): created successfully Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f354f9c-bb98-44a1-8b94-f169f2577190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (d6435fae-1f5f-4e33-a48e-84c418ae9134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b1c73a91-cac8-4fba-b7a2-b5894956a4a0 tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Creating offline snapshot dfebb016-e0d5-46e8-8c47-9096fc7bd737 of volume 65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5db6db-51d0-4cce-b2d9-a971acc16a4d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:38 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9" returned: 0 in 0.450s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:38 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9 Nov 02 14:41:38 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:38 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 Nov 02 14:41:38 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:38 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609.3626a2e1-79e4-42b6-bb82-2a58be4a07b9" returned: 0 in 0.272s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-3626a2e1-79e4-42b6-bb82-2a58be4a07b9" released by "_delete_snapshot" :: held 1.800s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-609cc031-3f65-4cb6-8699-0befef49f609" released by "delete_snapshot" :: held 1.828s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:38 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946" returned: 0 in 0.423s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:38 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 1G Nov 02 14:41:38 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Created reservations ['3ea74213-d9b4-4d7e-b484-8f4ed5290d96', '3b28ed86-dfc9-4267-b665-faa5b0b84304', '871a2d35-2011-45e8-92ba-70d09762f08d', 'c80f4a83-1659-4bde-b8e4-b38ec224fc90'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Delete snapshot completed successfully. Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fd61278e-3247-42fc-9eca-fb461589d6cf tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-3626a2e1-79e4-42b6-bb82-2a58be4a07b9-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "cinder-609cc031-3f65-4cb6-8699-0befef49f609-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-609cc031-3f65-4cb6-8699-0befef49f609-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "cinder-quobyte-609cc031-3f65-4cb6-8699-0befef49f609" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-609cc031-3f65-4cb6-8699-0befef49f609" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93cd651-31fe-4a9f-bb88-1b2c52881a1b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:39 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:39 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 1G" returned: 0 in 0.562s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:39 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d3769f-0d49-442e-af51-da3e1c379946 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:39 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d3769f-0d49-442e-af51-da3e1c379946 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 Nov 02 14:41:39 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:39 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 Nov 02 14:41:39 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:39 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:41:39 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609" returned: 0 in 0.533s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:39 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609 Nov 02 14:41:39 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:39 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65d3769f-0d49-442e-af51-da3e1c379946 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737" returned: 0 in 0.600s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:39 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 is being set with open permissions: ugo+rw Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:39 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 Nov 02 14:41:39 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:39 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-609cc031-3f65-4cb6-8699-0befef49f609" returned: 0 in 0.315s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:39 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-609cc031-3f65-4cb6-8699-0befef49f609" released by "delete_volume" :: held 0.931s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Created reservations ['3c71723b-c332-4801-8728-6df2070fd3aa', '009179f4-d3c4-4a76-96f9-269e6714503e', 'dffa3f37-57b9-482e-81a2-9b2711e1f588', '7ca70e99-c21a-4d45-929d-4abd122c091e'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:40 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737" returned: 0 in 0.275s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:40 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:40 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "cinder-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:40 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.info Nov 02 14:41:40 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "cinder-quobyte-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3" acquired by "delete_volume" :: waited 0.043s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[09feffa9-144d-42f6-97c5-549cd0f44302]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:40 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 Nov 02 14:41:40 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:40 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.438s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:40 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Deleted volume successfully. Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-94be2d76-5353-4688-a2ca-e41f74bab2be tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-609cc031-3f65-4cb6-8699-0befef49f609-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:40 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.info" returned: 0 in 0.535s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:40 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.info is being set with open permissions: ugo+rw Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:40 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.info Nov 02 14:41:40 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:40 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3" returned: 0 in 0.503s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:40 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3 Nov 02 14:41:40 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:40 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.info" returned: 0 in 0.338s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.236s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot 73469bb6-3678-4d0a-a4c9-a13af14a3911 of volume abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:41 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2abe1ec1-86b1-4c61-aa61-40b10b3b066d tempest-ProjectReaderTests-1316139843 None] Create snapshot completed successfully Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedd1f36-a3f9-4cf1-bbae-5c708065a8e0]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:41 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3" returned: 0 in 0.355s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:41 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 Nov 02 14:41:41 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-quobyte-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3" released by "delete_volume" :: held 0.914s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Created reservations ['8bc6d7b5-e449-4dd2-a589-c78f546e7e39', 'b85fe693-ffe4-4cf6-88c4-2174d31c699b', '20d8e0e4-8a8a-456b-8f3a-4ac723cea9e4', '20f328c0-443e-48ae-9bae-52fb5f224ee8'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:41 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:41 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-dfebb016-e0d5-46e8-8c47-9096fc7bd737-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-dfebb016-e0d5-46e8-8c47-9096fc7bd737-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-65d3769f-0d49-442e-af51-da3e1c379946" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-65d3769f-0d49-442e-af51-da3e1c379946" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-dfebb016-e0d5-46e8-8c47-9096fc7bd737" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-dfebb016-e0d5-46e8-8c47-9096fc7bd737" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:41 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Deleting offline snapshot dfebb016-e0d5-46e8-8c47-9096fc7bd737 of volume 65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] snapshot_file for this snap is: volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" returned: 0 in 0.608s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[26221c89-8c55-426f-9511-7160c5eb8453]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:41 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 1G Nov 02 14:41:41 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:41 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 Nov 02 14:41:41 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:41 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.521s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:41 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Deleted volume successfully. Nov 02 14:41:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2dd98a34-bd23-46a5-872b-62d545815887 tempest-CinderUnicodeTest-2146847792 None] Lock "cinder-3cf5de9b-5bbb-4287-a3d0-6d9ce76b92a3-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:42 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 1G" returned: 0 in 0.563s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:42 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737" returned: 0 in 0.575s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65d3769f-0d49-442e-af51-da3e1c379946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:42 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 Nov 02 14:41:42 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b767e29-034e-4759-8025-0a349e96e144]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:42 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 Nov 02 14:41:42 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:42 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911" returned: 0 in 0.439s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:42 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 is being set with open permissions: ugo+rw Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:42 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 Nov 02 14:41:42 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:42 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946" returned: 0 in 0.552s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:42 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 Nov 02 14:41:42 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:43 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911" returned: 0 in 0.324s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:43 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.info Nov 02 14:41:43 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:43 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737" returned: 0 in 0.438s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:43 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737 Nov 02 14:41:43 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:43 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.info" returned: 0 in 0.353s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:43 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.info is being set with open permissions: ugo+rw Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:43 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.info Nov 02 14:41:43 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:43 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946.dfebb016-e0d5-46e8-8c47-9096fc7bd737" returned: 0 in 0.351s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-dfebb016-e0d5-46e8-8c47-9096fc7bd737" released by "_delete_snapshot" :: held 2.114s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-65d3769f-0d49-442e-af51-da3e1c379946" released by "delete_snapshot" :: held 2.173s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:43 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.info" returned: 0 in 0.402s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b1e7d16e-94e3-4887-93c1-647875badf0c tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:41:43 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Created reservations ['2718929b-22e9-4e79-8fb8-25dc055d3665', '6506d825-1fde-49e2-8c8f-e033400fbc7e', '75ffc754-ec17-46f8-ad14-efc01cf62612', '022465fa-0cec-49f7-896e-8dc85b9c2980'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Delete snapshot completed successfully. Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6574d125-2836-45b0-a238-3c6bd0c90d89 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-dfebb016-e0d5-46e8-8c47-9096fc7bd737-delete_snapshot" released by "delete_snapshot" :: held 2.450s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-73469bb6-3678-4d0a-a4c9-a13af14a3911-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-73469bb6-3678-4d0a-a4c9-a13af14a3911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-73469bb6-3678-4d0a-a4c9-a13af14a3911" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-73469bb6-3678-4d0a-a4c9-a13af14a3911" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot 73469bb6-3678-4d0a-a4c9-a13af14a3911 of volume abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21bc761-2873-47c4-94ad-c805bf30f7e1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:44 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 Nov 02 14:41:44 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:44 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911" returned: 0 in 0.429s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771bc71-3ba1-47a1-8529-1508f334e495]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-65d3769f-0d49-442e-af51-da3e1c379946-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:44 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 Nov 02 14:41:44 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-65d3769f-0d49-442e-af51-da3e1c379946-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-65d3769f-0d49-442e-af51-da3e1c379946" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-65d3769f-0d49-442e-af51-da3e1c379946" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf7273c-d59b-463c-826a-492b3e64d522]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:45 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 Nov 02 14:41:45 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:45 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" returned: 0 in 0.514s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:45 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 Nov 02 14:41:45 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:45 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946" returned: 0 in 0.438s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:45 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946 Nov 02 14:41:45 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:45 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911" returned: 0 in 0.461s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:45 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911 Nov 02 14:41:45 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:45 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-65d3769f-0d49-442e-af51-da3e1c379946" returned: 0 in 0.321s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-65d3769f-0d49-442e-af51-da3e1c379946" released by "delete_volume" :: held 0.880s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Created reservations ['4febcc7b-210e-457e-bc61-e814b370e725', 'bc6f5f02-9437-40a0-8678-162ef4f7c455', '12308ab0-d226-4275-bae9-a551be646d36', '1ae83a05-21fb-42c5-affb-5749f6224a6d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:45 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6.73469bb6-3678-4d0a-a4c9-a13af14a3911" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:46 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:46 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-73469bb6-3678-4d0a-a4c9-a13af14a3911" released by "_delete_snapshot" :: held 1.937s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" released by "delete_snapshot" :: held 1.960s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Created reservations ['efebeaa4-8f17-4274-b287-1f5ea7f43c10', 'c763aabf-e23e-4b25-b5e0-5c521d4e38c7', 'fc2706b8-aa5e-4314-870d-8af021390d3b', '396c3142-5ba5-480e-8ec5-64d52e1f09b0'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-fba271fb-3d8a-4b79-80a5-62084c2b9e67 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-73469bb6-3678-4d0a-a4c9-a13af14a3911-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Lock "cinder-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:46 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" acquired by "delete_volume" :: waited 0.027s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.492s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Deleted volume successfully. Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189f419-2855-49ad-8fe1-a35fce0d8168]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d1a9cdca-9311-4c6e-83f1-f3aae4662901 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-65d3769f-0d49-442e-af51-da3e1c379946-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:46 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 Nov 02 14:41:46 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (4860df76-0e0f-4d87-99ac-4185c2d6ba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d735b6a-f294-4316-a014-102ca27392fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d735b6a-f294-4316-a014-102ca27392fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546590201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c44d75-2871-407b-bd30-ae158819a9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:47Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c7dcba-1de7-4efd-8f14-924a36e4b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c7dcba-1de7-4efd-8f14-924a36e4b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ce6c91-6541-4e79-a6e7-12638f746311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ce6c91-6541-4e79-a6e7-12638f746311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c44d75-2871-407b-bd30-ae158819a9eb', 'volume_name': 'volume-e5c44d75-2871-407b-bd30-ae158819a9eb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f230effd-f1a5-41b7-a13d-739a7f5c7126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f230effd-f1a5-41b7-a13d-739a7f5c7126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1614c64-7596-4ce4-ab54-f91a9f671196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:46 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Volume e5c44d75-2871-407b-bd30-ae158819a9eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c44d75-2871-407b-bd30-ae158819a9eb', 'volume_size': 1} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1546590201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c44d75-2871-407b-bd30-ae158819a9eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:47Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Creating volume e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:46 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:46 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb 1073741824 Nov 02 14:41:46 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:46 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" returned: 0 in 0.484s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:47 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6 Nov 02 14:41:47 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:47 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" returned: 0 in 0.301s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6" released by "delete_volume" :: held 0.885s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Created reservations ['c2151419-0820-4942-be9b-9b9302111d9d', '63c9a077-88ca-45e8-89e2-27e27edf015a', 'a69cffed-2788-4f12-96f4-dcac39b2a6f1', '9fa66bdf-92ee-40ec-8973-d495976ca5af'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:47 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb 1073741824" returned: 0 in 0.615s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:47 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:47 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:47 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb Nov 02 14:41:47 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:47 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.378s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:47 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:41:47 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a4ac1f14-375c-43f6-817f-e689c708c0ec tempest-ProjectMemberTests-1133871797 None] Lock "cinder-abbcfcf7-d17d-4e69-ab5f-3b356b4297f6-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:48 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb" returned: 0 in 0.475s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1614c64-7596-4ce4-ab54-f91a9f671196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c44d75-2871-407b-bd30-ae158819a9eb', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869c4233-72e5-4564-9180-86206cdd82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:48 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Volume volume-e5c44d75-2871-407b-bd30-ae158819a9eb (e5c44d75-2871-407b-bd30-ae158819a9eb): created successfully Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869c4233-72e5-4564-9180-86206cdd82cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (4860df76-0e0f-4d87-99ac-4185c2d6ba61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-55cc4066-d54b-4463-90c3-c6cb292a2da5 tempest-ProjectReaderTests-1316139843 None] Created volume successfully. Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (4def51da-57fc-43cb-8402-ae16cdf21bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacebdc4-70f6-4917-bd65-d05fe6694ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eacebdc4-70f6-4917-bd65-d05fe6694ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242208121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea2f478-192b-4d8b-a36a-566e076c56b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:48Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13b7bc9-7286-4167-b738-0d182a22c8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13b7bc9-7286-4167-b738-0d182a22c8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e015cc-2f55-4c68-b9a0-2a2ad7b1d85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e015cc-2f55-4c68-b9a0-2a2ad7b1d85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea2f478-192b-4d8b-a36a-566e076c56b3', 'volume_name': 'volume-7ea2f478-192b-4d8b-a36a-566e076c56b3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d287493-3d07-465d-83c8-72485e24c866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d287493-3d07-465d-83c8-72485e24c866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df07f50c-dd2f-4884-9140-afc518766d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:48 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Volume 7ea2f478-192b-4d8b-a36a-566e076c56b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea2f478-192b-4d8b-a36a-566e076c56b3', 'volume_size': 1} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242208121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea2f478-192b-4d8b-a36a-566e076c56b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:48Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Creating volume 7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:48 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:48 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 1073741824 Nov 02 14:41:48 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:49 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 1073741824" returned: 0 in 0.568s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:49 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 Nov 02 14:41:49 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:49 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3" returned: 0 in 0.315s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.155s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df07f50c-dd2f-4884-9140-afc518766d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea2f478-192b-4d8b-a36a-566e076c56b3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e2e44c-b915-4a34-a81f-b026551b0d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Creating offline snapshot 7ce91349-073e-4151-bfed-2bc736dc8f9f of volume e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:49 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Volume volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 (7ea2f478-192b-4d8b-a36a-566e076c56b3): created successfully Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e2e44c-b915-4a34-a81f-b026551b0d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (4def51da-57fc-43cb-8402-ae16cdf21bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc15e7b-02fb-4102-bc61-6d734cde84ef]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:49 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ae61e100-cf24-4743-b6f5-78924b22a9ae tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:41:49 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb Nov 02 14:41:49 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:49 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb" returned: 0 in 0.422s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:49 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f 1G Nov 02 14:41:49 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:50 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f 1G" returned: 0 in 0.573s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c44d75-2871-407b-bd30-ae158819a9eb -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:50 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c44d75-2871-407b-bd30-ae158819a9eb -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f Nov 02 14:41:50 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:50 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c44d75-2871-407b-bd30-ae158819a9eb -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f" returned: 0 in 0.420s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:50 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f is being set with open permissions: ugo+rw Nov 02 14:41:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:50 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f Nov 02 14:41:50 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:51 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f" returned: 0 in 0.317s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:51 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.info Nov 02 14:41:51 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:51 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.info" returned: 0 in 0.326s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:51 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.info is being set with open permissions: ugo+rw Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:51 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.info Nov 02 14:41:51 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:51 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.info" returned: 0 in 0.336s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.256s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot e68cba5d-1220-45c0-b0e2-921a2e51b369 of volume 7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3d1f8060-09f9-444f-b1f7-410c3741ae4f tempest-ProjectReaderTests-1316139843 None] Create snapshot completed successfully Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cd2738-7a9c-4fcd-b783-bb13a37605af]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:52 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 Nov 02 14:41:52 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-7ce91349-073e-4151-bfed-2bc736dc8f9f-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-7ce91349-073e-4151-bfed-2bc736dc8f9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-e5c44d75-2871-407b-bd30-ae158819a9eb" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:52 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3" returned: 0 in 0.498s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-e5c44d75-2871-407b-bd30-ae158819a9eb" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-7ce91349-073e-4151-bfed-2bc736dc8f9f" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-7ce91349-073e-4151-bfed-2bc736dc8f9f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:52 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 1G Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Deleting offline snapshot 7ce91349-073e-4151-bfed-2bc736dc8f9f of volume e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:52 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] snapshot_file for this snap is: volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc9701-bd8e-4659-9503-386e0e0bf2ef]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:52 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f Nov 02 14:41:52 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:53 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f" returned: 0 in 0.482s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c44d75-2871-407b-bd30-ae158819a9eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:53 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 1G" returned: 0 in 0.633s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af6d0c-c15f-4d7d-9e36-7375cd3991fb]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:53 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 Nov 02 14:41:53 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:53 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb Nov 02 14:41:53 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:53 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369" returned: 0 in 0.308s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:53 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 is being set with open permissions: ugo+rw Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:53 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 Nov 02 14:41:53 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:53 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:53 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f Nov 02 14:41:53 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:53 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369" returned: 0 in 0.349s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:53 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.info Nov 02 14:41:53 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:54 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:54 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f Nov 02 14:41:54 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:54 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.info" returned: 0 in 0.323s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:54 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.info is being set with open permissions: ugo+rw Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:54 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.info Nov 02 14:41:54 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:54 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb.7ce91349-073e-4151-bfed-2bc736dc8f9f" returned: 0 in 0.295s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-7ce91349-073e-4151-bfed-2bc736dc8f9f" released by "_delete_snapshot" :: held 1.831s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-e5c44d75-2871-407b-bd30-ae158819a9eb" released by "delete_snapshot" :: held 1.874s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Created reservations ['82c48a42-df88-4e80-9cb7-971612ab343a', '1e2aeb38-2572-4b49-988a-64af560b4500', 'e9d9747f-7db1-4a06-8ffe-6a0615036086', '73b62440-902b-4c0c-8b81-d689906674a2'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:54 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.info" returned: 0 in 0.415s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-ff05531b-c14f-4bd5-902b-621809bc4396 tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:41:54 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Delete snapshot completed successfully. Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9b4653db-d704-414e-b521-0b82999e9361 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-7ce91349-073e-4151-bfed-2bc736dc8f9f-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-e68cba5d-1220-45c0-b0e2-921a2e51b369-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-e68cba5d-1220-45c0-b0e2-921a2e51b369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-7ea2f478-192b-4d8b-a36a-566e076c56b3" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-7ea2f478-192b-4d8b-a36a-566e076c56b3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-e68cba5d-1220-45c0-b0e2-921a2e51b369" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-e68cba5d-1220-45c0-b0e2-921a2e51b369" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot e68cba5d-1220-45c0-b0e2-921a2e51b369 of volume 7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e260767-dd9e-4ebc-82ab-d70a9cc73614]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:55 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 Nov 02 14:41:55 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:55 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea2f478-192b-4d8b-a36a-566e076c56b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c169c09f-edb3-491e-afd8-7ce8c7c78578]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:55 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 Nov 02 14:41:55 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Flow 'volume_create_manager' (f96fc428-8ec3-4d92-89a9-c8aef2b88f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b4a4f7-6bd4-40ce-afb6-aeca3ce47f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b4a4f7-6bd4-40ce-afb6-aeca3ce47f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1090541250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4f500a-c155-4a4a-adf6-6809bf669dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9267e595c564170909ad550cb0d28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:56Z,use_quota=True,user_id='aa95961db14542d399c0b2dc868c72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e8d34f-df7e-449f-8dd0-b6733ae65a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e8d34f-df7e-449f-8dd0-b6733ae65a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2957fb0-2f40-4177-816d-35444e54ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2957fb0-2f40-4177-816d-35444e54ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4f500a-c155-4a4a-adf6-6809bf669dd6', 'volume_name': 'volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accea3b7-22f2-4f55-bc9f-60e2dd1479bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accea3b7-22f2-4f55-bc9f-60e2dd1479bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c939fd2-0fbc-4f32-add1-0737d02fe554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:55 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Volume 6e4f500a-c155-4a4a-adf6-6809bf669dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6', 'volume_size': 1} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1090541250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4f500a-c155-4a4a-adf6-6809bf669dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9267e595c564170909ad550cb0d28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:56Z,use_quota=True,user_id='aa95961db14542d399c0b2dc868c72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Creating volume 6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:55 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-e5c44d75-2871-407b-bd30-ae158819a9eb-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:55 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 1073741824 Nov 02 14:41:55 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-e5c44d75-2871-407b-bd30-ae158819a9eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-e5c44d75-2871-407b-bd30-ae158819a9eb" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-e5c44d75-2871-407b-bd30-ae158819a9eb" acquired by "delete_volume" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3f8d9-1d55-4594-aed1-75e19750a951]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:55 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3" returned: 0 in 0.425s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:55 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 Nov 02 14:41:55 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:55 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb Nov 02 14:41:55 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:56 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 1073741824" returned: 0 in 0.481s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:56 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb" returned: 0 in 0.395s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:56 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:56 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 Nov 02 14:41:56 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:56 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb Nov 02 14:41:56 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:56 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369 Nov 02 14:41:56 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:56 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6" returned: 0 in 0.282s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:56 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-e5c44d75-2871-407b-bd30-ae158819a9eb" returned: 0 in 0.276s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:56 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3.e68cba5d-1220-45c0-b0e2-921a2e51b369" returned: 0 in 0.280s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-e5c44d75-2871-407b-bd30-ae158819a9eb" released by "delete_volume" :: held 0.743s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c939fd2-0fbc-4f32-add1-0737d02fe554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4cd885-fa6a-4a09-b762-f5fc84b7d4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:56 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Volume volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 (6e4f500a-c155-4a4a-adf6-6809bf669dd6): created successfully Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4cd885-fa6a-4a09-b762-f5fc84b7d4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Flow 'volume_create_manager' (f96fc428-8ec3-4d92-89a9-c8aef2b88f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-e68cba5d-1220-45c0-b0e2-921a2e51b369" released by "_delete_snapshot" :: held 1.633s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-7ea2f478-192b-4d8b-a36a-566e076c56b3" released by "delete_snapshot" :: held 1.656s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:56 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0c3c23f7-f23a-4f1a-97a2-68e1be58d327 tempest-SnapshotDependencyTests-667928575 None] Created volume successfully. Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Created reservations ['7125cab7-613b-4674-b69a-d5fd40833bb9', 'a8e07af2-1b3b-45e7-b42f-faec53c8e691', 'ad086f90-9c41-4b31-ad8a-9dc5dfc41bb5', '6833c493-bf82-4524-8717-ed493a1506ae'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Created reservations ['e097f7af-c2fa-43d2-9184-b997a80eba3e', '345a4e19-02d6-4741-b825-307e512ffabf', '0250a118-e8a3-49c0-b2eb-fb9cd646c703', '726c668c-a5f2-410a-ae51-aede8d539559'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:56 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:56 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:56 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a8cf9fcd-45dc-44ce-a7fe-9b5067a8d235 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-e68cba5d-1220-45c0-b0e2-921a2e51b369-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:56 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.260s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:56 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Deleted volume successfully. Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d9f59329-47de-427d-851a-2b38e4440e16 tempest-ProjectReaderTests-1316139843 None] Lock "cinder-e5c44d75-2871-407b-bd30-ae158819a9eb-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-7ea2f478-192b-4d8b-a36a-566e076c56b3-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-7ea2f478-192b-4d8b-a36a-566e076c56b3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-7ea2f478-192b-4d8b-a36a-566e076c56b3" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-7ea2f478-192b-4d8b-a36a-566e076c56b3" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0df3201-93d1-4bf2-a052-4ecf7a12cb4d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:57 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 Nov 02 14:41:57 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (19064eb6-9299-4a71-b503-34cf8047e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dca39b8-d4c7-41ec-91c8-7ce89df7eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dca39b8-d4c7-41ec-91c8-7ce89df7eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971740161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e8391b-0fc3-48a5-86f6-b4b24abe0184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:57Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad3e21c-b4a7-4da4-a65d-c4af95c97466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad3e21c-b4a7-4da4-a65d-c4af95c97466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cd806c-a9ee-46d0-9230-fb11bdc104af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cd806c-a9ee-46d0-9230-fb11bdc104af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e8391b-0fc3-48a5-86f6-b4b24abe0184', 'volume_name': 'volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0217eb-9290-45c7-b93c-360b266a1f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0217eb-9290-45c7-b93c-360b266a1f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e841eccf-939f-4350-bf21-6cd42313abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:57 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Volume 75e8391b-0fc3-48a5-86f6-b4b24abe0184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184', 'volume_size': 1} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-971740161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e8391b-0fc3-48a5-86f6-b4b24abe0184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c93a6d0a543bdbc73d0ca6eeeb902',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:57Z,use_quota=True,user_id='9a04b1f86ff149a98d79fe5ce59f94da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Creating volume 75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:41:57 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:57 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 1073741824 Nov 02 14:41:57 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:57 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3" returned: 0 in 0.394s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:57 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3 Nov 02 14:41:57 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:57 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-7ea2f478-192b-4d8b-a36a-566e076c56b3" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:57 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-7ea2f478-192b-4d8b-a36a-566e076c56b3" released by "delete_volume" :: held 0.746s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 1073741824" returned: 0 in 0.511s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Created reservations ['927d8b7a-0f58-49b7-9542-1e876c75171f', '8a88462b-a6df-4c7b-a967-71bbd3c9bbba', '94f5ace9-87ae-4d2d-ac23-69c578358be9', '518883ba-d46d-4370-88a2-d1f3e47b845c'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:41:58 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 Nov 02 14:41:58 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:58 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:41:58 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:58 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184" returned: 0 in 0.274s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.363s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e841eccf-939f-4350-bf21-6cd42313abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5fb848-2872-4d59-9a06-31852fe9d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Creating offline snapshot 26bb559f-5be0-4814-8257-306b1f003ee5 of volume 6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:41:58 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Volume volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 (75e8391b-0fc3-48a5-86f6-b4b24abe0184): created successfully Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5fb848-2872-4d59-9a06-31852fe9d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Flow 'volume_create_manager' (19064eb6-9299-4a71-b503-34cf8047e705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[182f259b-1a85-4b71-938c-d00c41af83d4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:58 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.281s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:41:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1ebc388c-9b74-4845-8ee7-fd27837524a2 tempest-ProjectReaderTests-1316139843 None] Created volume successfully. Nov 02 14:41:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-527263cb-cfd1-4627-b287-28e75f5192e4 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-7ea2f478-192b-4d8b-a36a-566e076c56b3-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:41:58 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 Nov 02 14:41:58 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:58 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6" returned: 0 in 0.419s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:41:58 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 1G Nov 02 14:41:58 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (8d4f529d-21b4-414a-84ff-b75101fada48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a43998-335b-4704-9143-32f9a37482fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a43998-335b-4704-9143-32f9a37482fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555862503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e811a4-e919-4e21-8d23-a57222d998d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:59Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583d8897-c70b-4374-b66b-6499ff23029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583d8897-c70b-4374-b66b-6499ff23029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eeac9a-9e5c-419f-916a-7752aa26591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4eeac9a-9e5c-419f-916a-7752aa26591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e811a4-e919-4e21-8d23-a57222d998d3', 'volume_name': 'volume-60e811a4-e919-4e21-8d23-a57222d998d3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf6fbbb-e90b-4414-9ed2-fd19a9e7e36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf6fbbb-e90b-4414-9ed2-fd19a9e7e36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807f3ad5-6d53-4d61-bf6d-d0c84f764cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:41:58 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Volume 60e811a4-e919-4e21-8d23-a57222d998d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e811a4-e919-4e21-8d23-a57222d998d3', 'volume_size': 1} Nov 02 14:41:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:59 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 1G" returned: 0 in 0.388s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:59 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 Nov 02 14:41:59 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:59 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5" returned: 0 in 0.317s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:59 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 is being set with open permissions: ugo+rw Nov 02 14:41:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:59 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 Nov 02 14:41:59 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:41:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:41:59 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Nov 02 14:41:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5" returned: 0 in 0.253s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:41:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:41:59 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.info Nov 02 14:41:59 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:00 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.info" returned: 0 in 0.258s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:00 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.info is being set with open permissions: ugo+rw Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:00 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.info Nov 02 14:42:00 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:00 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.info" returned: 0 in 0.247s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555862503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e811a4-e919-4e21-8d23-a57222d998d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:41:59Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Creating volume 60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:00 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:00 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 1073741824 Nov 02 14:42:00 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7b0fe122-db1a-49db-9d54-148ea8561f83 tempest-SnapshotDependencyTests-667928575 None] Create snapshot completed successfully Nov 02 14:42:00 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 1073741824" returned: 0 in 0.462s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:00 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 Nov 02 14:42:00 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:01 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3" returned: 0 in 0.249s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.454s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807f3ad5-6d53-4d61-bf6d-d0c84f764cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e811a4-e919-4e21-8d23-a57222d998d3', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4da704-d57f-46d2-bb9d-db98cac46f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Creating offline snapshot 63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 of volume 75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7612d40-5fde-424c-befe-64704ea0d942]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:01 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Volume volume-60e811a4-e919-4e21-8d23-a57222d998d3 (60e811a4-e919-4e21-8d23-a57222d998d3): created successfully Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4da704-d57f-46d2-bb9d-db98cac46f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (8d4f529d-21b4-414a-84ff-b75101fada48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:01 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-83029851-7611-4f9d-a7ae-4365ef1292c6 tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:42:01 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 Nov 02 14:42:01 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:01 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184" returned: 0 in 0.398s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:01 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 1G Nov 02 14:42:01 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Flow 'volume_create_manager' (4f824dba-0ffc-4831-bcac-54486514aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bced5de0-87a9-408c-a8fe-aed6e9f0638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bced5de0-87a9-408c-a8fe-aed6e9f0638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9267e595c564170909ad550cb0d28be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26bb559f-5be0-4814-8257-306b1f003ee5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:02Z,use_quota=True,user_id='aa95961db14542d399c0b2dc868c72b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78231b-b22a-4542-b1cb-e50745fb4640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc78231b-b22a-4542-b1cb-e50745fb4640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4972c15-26f0-4014-82b3-1965920b2235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4972c15-26f0-4014-82b3-1965920b2235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b', 'volume_name': 'volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b', 'volume_size': 1, 'snapshot_id': '26bb559f-5be0-4814-8257-306b1f003ee5'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae599dbe-3ea4-406d-9f01-97590a2be65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae599dbe-3ea4-406d-9f01-97590a2be65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce2cba4-6d61-45f0-82f5-2dab67a3530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:01 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Volume bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b', 'volume_size': 1, 'snapshot_id': '26bb559f-5be0-4814-8257-306b1f003ee5'} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:01 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 1G" returned: 0 in 0.449s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:02 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 Nov 02 14:42:02 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:02 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" returned: 0 in 0.285s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:02 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 is being set with open permissions: ugo+rw Nov 02 14:42:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:02 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 Nov 02 14:42:02 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:02 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" returned: 0 in 0.241s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:02 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.info Nov 02 14:42:02 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:02 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.info" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:02 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.info is being set with open permissions: ugo+rw Nov 02 14:42:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:02 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.info Nov 02 14:42:02 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:03 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.info" returned: 0 in 0.237s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.306s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-quobyte-26bb559f-5be0-4814-8257-306b1f003ee5-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" by "_create_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-26bb559f-5be0-4814-8257-306b1f003ee5-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Creating volume bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b from snapshot 26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-quobyte-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" by "_copy_volume_from_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] snapshot: 26bb559f-5be0-4814-8257-306b1f003ee5, volume: bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b, {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 14:42:03 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f8b22bfd-483a-4d6a-8fd7-9430c4fa0f74 tempest-ProjectReaderTests-1316139843 None] Create snapshot completed successfully Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a999c05a-624f-4786-ace1-b06985ab15bb]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:03 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 Nov 02 14:42:03 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:03 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9485b-8790-47a9-b67f-35c10c5bb441]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:03 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 Nov 02 14:42:03 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-63b8b0e7-2a9a-4211-a78b-b567e4e21ca7-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-63b8b0e7-2a9a-4211-a78b-b567e4e21ca7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-75e8391b-0fc3-48a5-86f6-b4b24abe0184" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-75e8391b-0fc3-48a5-86f6-b4b24abe0184" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Deleting offline snapshot 63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 of volume 75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] snapshot_file for this snap is: volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f9d467-0e7d-49c3-b92b-da00e19727ee]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:03 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6" returned: 0 in 0.408s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Creating direct copy from snapshot {{(pid=86978) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG cinder.utils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Path /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b not found in is_blk_device check {{(pid=86978) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 14:42:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:03 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b Nov 02 14:42:03 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:04 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 Nov 02 14:42:04 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:04 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" returned: 0 in 0.370s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:04 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:04 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf37bb4-717c-4cc1-bf72-a1dcb0e18e7b]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:04 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 Nov 02 14:42:04 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:04 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184" returned: 0 in 0.552s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:04 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 Nov 02 14:42:04 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:05 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" returned: 0 in 0.667s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:05 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7 Nov 02 14:42:05 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:05 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:05 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184.63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" returned: 0 in 0.390s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-63b8b0e7-2a9a-4211-a78b-b567e4e21ca7" released by "_delete_snapshot" :: held 2.132s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-75e8391b-0fc3-48a5-86f6-b4b24abe0184" released by "delete_snapshot" :: held 2.174s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:06 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Created reservations ['69463a3a-24d8-4eca-b010-2df40652c29d', 'ec26a193-8251-4da2-9bf1-9c112774c3bc', '0f7f3c37-4db4-4947-b488-946b61682768', '915212a2-1d72-4a1a-bd37-33a72f26c2fc'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:06 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Delete snapshot completed successfully. Nov 02 14:42:06 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d3b68367-e203-4edf-8c1a-832b39e0f61b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-63b8b0e7-2a9a-4211-a78b-b567e4e21ca7-delete_snapshot" released by "delete_snapshot" :: held 2.460s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-75e8391b-0fc3-48a5-86f6-b4b24abe0184-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-75e8391b-0fc3-48a5-86f6-b4b24abe0184-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Acquiring lock "cinder-quobyte-75e8391b-0fc3-48a5-86f6-b4b24abe0184" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-75e8391b-0fc3-48a5-86f6-b4b24abe0184" acquired by "delete_volume" :: waited 0.038s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bafaff-4409-4825-b150-ea3c2f401411]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:07 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 Nov 02 14:42:07 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:07 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184" returned: 0 in 0.542s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:07 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:08 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184 Nov 02 14:42:08 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:08 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-75e8391b-0fc3-48a5-86f6-b4b24abe0184" returned: 0 in 0.322s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-quobyte-75e8391b-0fc3-48a5-86f6-b4b24abe0184" released by "delete_volume" :: held 0.998s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Created reservations ['7ea18935-3979-4587-b4be-6b9aaba0fabe', '26220ffa-79b4-4a4b-92dc-dc503978393b', '934242a8-b1e3-4764-ace9-18cda7f26298', 'da72d917-ddeb-4840-9cc2-cb6ae0e53468'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:08 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:08 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:08 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.424s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:08 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:08 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Deleted volume successfully. Nov 02 14:42:09 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-1909bab3-b028-4ae1-a1f5-719b8c5adf6b tempest-ProjectReaderTests-1316139843 None] Lock "cinder-75e8391b-0fc3-48a5-86f6-b4b24abe0184-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:10 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" returned: 0 in 6.819s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:10 devstack cinder-volume[86978]: DEBUG cinder.image.image_utils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Image conversion details: src /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b {{(pid=86978) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 14:42:10 devstack cinder-volume[86978]: INFO cinder.image.image_utils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Converted 1024.00 MB image at 150.15 MB/s Nov 02 14:42:10 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b is being set with open permissions: ugo+rw Nov 02 14:42:10 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:10 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b Nov 02 14:42:10 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:11 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" returned: 0 in 0.264s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" released by "_copy_volume_from_snapshot" :: held 7.969s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-26bb559f-5be0-4814-8257-306b1f003ee5-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" released by "_create_volume_from_snapshot" :: held 8.034s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.057s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.010s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot 750191dc-f28d-4353-9279-57b92adb9c6f of volume 60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce2cba4-6d61-45f0-82f5-2dab67a3530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b', 'volume_size': 1, 'snapshot_id': '26bb559f-5be0-4814-8257-306b1f003ee5'}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872c2739-0438-4581-bf2e-edd83ef4ccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca31e75-111d-4da7-a0a0-b6080dfaa68f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:11 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Volume volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b (bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b): created successfully Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872c2739-0438-4581-bf2e-edd83ef4ccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Flow 'volume_create_manager' (4f824dba-0ffc-4831-bcac-54486514aa14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:11 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c02b5a06-d1b6-449c-be07-63b0d426ce0e tempest-SnapshotDependencyTests-667928575 None] Created volume successfully. Nov 02 14:42:11 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 Nov 02 14:42:11 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-26bb559f-5be0-4814-8257-306b1f003ee5-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-26bb559f-5be0-4814-8257-306b1f003ee5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-quobyte-6e4f500a-c155-4a4a-adf6-6809bf669dd6" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-6e4f500a-c155-4a4a-adf6-6809bf669dd6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-quobyte-26bb559f-5be0-4814-8257-306b1f003ee5" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-26bb559f-5be0-4814-8257-306b1f003ee5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Deleting offline snapshot 26bb559f-5be0-4814-8257-306b1f003ee5 of volume 6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:11 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] snapshot_file for this snap is: volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3" returned: 0 in 0.488s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d30166a-1e6b-4586-a92b-7c64aa61005a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:11 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:11 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f 1G Nov 02 14:42:11 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:11 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 Nov 02 14:42:11 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:12 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5" returned: 0 in 0.438s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:12 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f 1G" returned: 0 in 0.478s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e811a4-e919-4e21-8d23-a57222d998d3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2efa19a-e0aa-4718-8cf8-2ce437ce46f5]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:12 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e811a4-e919-4e21-8d23-a57222d998d3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f Nov 02 14:42:12 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:12 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 Nov 02 14:42:12 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:12 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60e811a4-e919-4e21-8d23-a57222d998d3 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f" returned: 0 in 0.314s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:12 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f is being set with open permissions: ugo+rw Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:12 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f Nov 02 14:42:12 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:12 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f" returned: 0 in 0.274s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:12 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6" returned: 0 in 0.595s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:12 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:12 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 Nov 02 14:42:12 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:12 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.info Nov 02 14:42:12 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:13 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.info" returned: 0 in 0.278s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:13 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.info is being set with open permissions: ugo+rw Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:13 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.info Nov 02 14:42:13 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:13 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5" returned: 0 in 0.389s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:13 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5 Nov 02 14:42:13 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:13 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.info" returned: 0 in 0.248s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-3f65fdce-44b5-4114-9a65-104d3198ee3a tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:42:13 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6.26bb559f-5be0-4814-8257-306b1f003ee5" returned: 0 in 0.271s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-26bb559f-5be0-4814-8257-306b1f003ee5" released by "_delete_snapshot" :: held 1.835s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-6e4f500a-c155-4a4a-adf6-6809bf669dd6" released by "delete_snapshot" :: held 1.871s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Created reservations ['278733e3-364c-486d-a557-22cebcb93e1a', 'a486b3c6-3779-4f4b-a726-782d9b552de7', '3d77c36e-2772-4a04-9acf-3b9baf141e53', '327944c4-0190-49c8-aae0-a12926fb5222'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:13 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Delete snapshot completed successfully. Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-5ab2a180-f7a2-4e53-9ae8-b57b9f3d50bc tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-26bb559f-5be0-4814-8257-306b1f003ee5-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-750191dc-f28d-4353-9279-57b92adb9c6f-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-750191dc-f28d-4353-9279-57b92adb9c6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-60e811a4-e919-4e21-8d23-a57222d998d3" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-60e811a4-e919-4e21-8d23-a57222d998d3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-750191dc-f28d-4353-9279-57b92adb9c6f" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-750191dc-f28d-4353-9279-57b92adb9c6f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot 750191dc-f28d-4353-9279-57b92adb9c6f of volume 60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-6e4f500a-c155-4a4a-adf6-6809bf669dd6-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbca5138-c912-42fb-84c4-221c0aa46769]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-6e4f500a-c155-4a4a-adf6-6809bf669dd6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-quobyte-6e4f500a-c155-4a4a-adf6-6809bf669dd6" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:13 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-6e4f500a-c155-4a4a-adf6-6809bf669dd6" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:14 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f Nov 02 14:42:14 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e66fb69-4d41-48b0-bc61-1cf2afd21377]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Flow 'volume_create_manager' (0131a397-0e69-4ff2-a5b6-ab05c24c4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0466cd-892a-48f3-a6c2-8a3e6dca43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0466cd-892a-48f3-a6c2-8a3e6dca43c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653171726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d529240-72f1-43ec-aaea-6ecc035d8c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb42cce1013419e9f8a2f5e35d75677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:14Z,use_quota=True,user_id='dda1f684ed71415db6f5639ecee652ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:14 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 Nov 02 14:42:14 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b2c3a5-54b3-4b46-843d-27ca9739b970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b2c3a5-54b3-4b46-843d-27ca9739b970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478620a0-f948-463e-9a36-cdf8a2c4f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478620a0-f948-463e-9a36-cdf8a2c4f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d529240-72f1-43ec-aaea-6ecc035d8c38', 'volume_name': 'volume-2d529240-72f1-43ec-aaea-6ecc035d8c38', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9333d5-7094-42b5-9eb5-b913f9d5194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9333d5-7094-42b5-9eb5-b913f9d5194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b986f30d-ab6d-4a72-8709-b8eba989bd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:14 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Volume 2d529240-72f1-43ec-aaea-6ecc035d8c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d529240-72f1-43ec-aaea-6ecc035d8c38', 'volume_size': 1} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653171726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d529240-72f1-43ec-aaea-6ecc035d8c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb42cce1013419e9f8a2f5e35d75677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:14Z,use_quota=True,user_id='dda1f684ed71415db6f5639ecee652ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Creating volume 2d529240-72f1-43ec-aaea-6ecc035d8c38 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:14 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:14 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 1073741824 Nov 02 14:42:14 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f" returned: 0 in 0.436s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60e811a4-e919-4e21-8d23-a57222d998d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca2efcc-09f5-4993-ab42-3effbe21a5bf]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:14 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6" returned: 0 in 0.388s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:14 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6 Nov 02 14:42:14 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 Nov 02 14:42:14 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 1073741824" returned: 0 in 0.469s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:14 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-6e4f500a-c155-4a4a-adf6-6809bf669dd6" returned: 0 in 0.296s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:14 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 Nov 02 14:42:14 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-6e4f500a-c155-4a4a-adf6-6809bf669dd6" released by "delete_volume" :: held 0.767s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3" returned: 0 in 0.423s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:14 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f Nov 02 14:42:14 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Created reservations ['661ea74d-17fb-4864-9f49-fb25f0442330', 'aee71c57-0452-4904-82a4-acdee21ffa06', 'a48f3f47-7e0e-4738-a876-411201324708', 'ac558d69-c757-4fed-a364-a8d6dbb7b44a'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:14 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:14 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:14 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38" returned: 0 in 0.257s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b986f30d-ab6d-4a72-8709-b8eba989bd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d529240-72f1-43ec-aaea-6ecc035d8c38', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:14 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa4d79b-5030-471f-802a-29fff23fd82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:15 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Volume volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 (2d529240-72f1-43ec-aaea-6ecc035d8c38): created successfully Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa4d79b-5030-471f-802a-29fff23fd82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Flow 'volume_create_manager' (0131a397-0e69-4ff2-a5b6-ab05c24c4006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-95dc71a2-cc26-45d9-bbcf-3f04dd9344eb tempest-ProjectReaderTests-675108922 None] Created volume successfully. Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "cinder-quobyte-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:15 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f" returned: 0 in 0.422s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:15 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.304s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:15 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f Nov 02 14:42:15 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Deleted volume successfully. Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b7ae2c-43db-44e2-b8b8-f07c6429f6bb]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-7f039a10-38ea-4636-a950-aedd778b4d8e tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-6e4f500a-c155-4a4a-adf6-6809bf669dd6-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:15 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b Nov 02 14:42:15 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:15 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3.750191dc-f28d-4353-9279-57b92adb9c6f" returned: 0 in 0.246s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-750191dc-f28d-4353-9279-57b92adb9c6f" released by "_delete_snapshot" :: held 1.652s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-60e811a4-e919-4e21-8d23-a57222d998d3" released by "delete_snapshot" :: held 1.680s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Created reservations ['3ed92967-147e-4b93-9f1b-02627eae985a', '5bda4e6f-6f0d-416d-b363-3e4397e2e6b4', 'ffd46ac8-fc72-4429-96d1-1eda82b4dacc', '169ae271-a420-4ace-9e24-5a235c3b52c6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:15 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9d5aa950-15e4-429a-81c6-74d05a99524b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-750191dc-f28d-4353-9279-57b92adb9c6f-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:15 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" returned: 0 in 0.387s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:15 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b Nov 02 14:42:15 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:15 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" returned: 0 in 0.240s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-quobyte-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b" released by "delete_volume" :: held 0.676s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Created reservations ['66f73a5c-5880-4f7b-ba2e-adc9e3a5f4e5', '3985683b-3100-4373-ad7c-fe0c526b15a1', 'bf215ad9-6bf3-4847-bfaa-c3e8c398e1bd', '1cf2b573-1dfd-4f4f-b97c-99950426a700'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:15 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-60e811a4-e919-4e21-8d23-a57222d998d3-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:16 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:16 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-60e811a4-e919-4e21-8d23-a57222d998d3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-60e811a4-e919-4e21-8d23-a57222d998d3" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-60e811a4-e919-4e21-8d23-a57222d998d3" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7e0c0e-32b4-4392-b09a-960119e68217]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:16 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 Nov 02 14:42:16 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:16 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.353s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:16 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Deleted volume successfully. Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-39da1a19-f186-4906-979d-13c0e7154bee tempest-SnapshotDependencyTests-667928575 None] Lock "cinder-bbc4dc02-f3af-4dc2-a46e-80edf24e2a1b-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Acquiring lock "cinder-2d529240-72f1-43ec-aaea-6ecc035d8c38-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Lock "cinder-2d529240-72f1-43ec-aaea-6ecc035d8c38-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Acquiring lock "cinder-quobyte-2d529240-72f1-43ec-aaea-6ecc035d8c38" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Lock "cinder-quobyte-2d529240-72f1-43ec-aaea-6ecc035d8c38" acquired by "delete_volume" :: waited 0.025s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee4fdb4-c274-4bc0-8e1f-1233e6fbd646]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:16 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:16 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3 Nov 02 14:42:16 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:16 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 Nov 02 14:42:16 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:16 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-60e811a4-e919-4e21-8d23-a57222d998d3" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-60e811a4-e919-4e21-8d23-a57222d998d3" released by "delete_volume" :: held 0.782s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:16 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38" returned: 0 in 0.413s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:16 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Created reservations ['9cdf05c8-2c5b-4a35-8b9a-c918dcea3da2', 'c8b67e28-74b3-4632-8450-5b4616868335', 'b1eff046-db3b-4ac2-8c51-cad518f93b37', '85d98f74-2640-4331-8132-0ff596f0e9fe'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:16 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38 Nov 02 14:42:16 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:17 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:17 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:17 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-2d529240-72f1-43ec-aaea-6ecc035d8c38" returned: 0 in 0.347s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Lock "cinder-quobyte-2d529240-72f1-43ec-aaea-6ecc035d8c38" released by "delete_volume" :: held 0.835s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Created reservations ['fc1a67f5-dd48-4f4a-9721-4850ab5d64a1', '35ec854e-3f48-4a92-b52b-b791b259b909', 'c13f4b55-d72a-4da0-9079-d05244880732', 'add42579-03c8-4677-b09d-7d2d10bbdcd6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:17 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.361s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:17 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2489444a-dc4f-4b34-9780-81f017ba9c8b tempest-ProjectMemberTests-1133871797 None] Lock "cinder-60e811a4-e919-4e21-8d23-a57222d998d3-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:17 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:17 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:17 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.370s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:17 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Deleted volume successfully. Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (b9749af0-dd0f-4cb7-8587-bac21e20e3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eac147-b239-43bb-857f-44b31e003eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-f99030bf-e29d-494f-9c95-6680803499d1 tempest-ProjectReaderTests-675108922 None] Lock "cinder-2d529240-72f1-43ec-aaea-6ecc035d8c38-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eac147-b239-43bb-857f-44b31e003eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782990149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced75285-2133-4090-8e8e-e2b612e2993d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:18Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14a5af7-945d-4115-ad56-8870832f3966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14a5af7-945d-4115-ad56-8870832f3966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c735e88-0747-4351-a979-1cff24bb32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c735e88-0747-4351-a979-1cff24bb32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced75285-2133-4090-8e8e-e2b612e2993d', 'volume_name': 'volume-ced75285-2133-4090-8e8e-e2b612e2993d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebec61f4-33c0-40cf-abbf-b274571c6e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebec61f4-33c0-40cf-abbf-b274571c6e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4939f19-0518-4399-882c-3d4a2372a57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:17 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Volume ced75285-2133-4090-8e8e-e2b612e2993d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced75285-2133-4090-8e8e-e2b612e2993d', 'volume_size': 1} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-782990149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced75285-2133-4090-8e8e-e2b612e2993d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:18Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Creating volume ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:17 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:17 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:18 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d 1073741824 Nov 02 14:42:18 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Flow 'volume_create_manager' (8e17f7ca-e2b6-4f2e-a717-c3a4b0edafe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dc7997-ed22-4dea-bdcf-13de4c19616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dc7997-ed22-4dea-bdcf-13de4c19616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-740652241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da50921-b9cc-4bbd-b7cd-0552924c5efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb42cce1013419e9f8a2f5e35d75677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:18Z,use_quota=True,user_id='dda1f684ed71415db6f5639ecee652ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e482b20-9f44-47c7-be52-31d03fc94e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e482b20-9f44-47c7-be52-31d03fc94e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c3a317-da67-43d9-b5e4-a650b21c00a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c3a317-da67-43d9-b5e4-a650b21c00a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da50921-b9cc-4bbd-b7cd-0552924c5efc', 'volume_name': 'volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1494b1-79b6-4856-8874-84d74ac95b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1494b1-79b6-4856-8874-84d74ac95b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f87ba4-afb4-42ff-8b0d-8b57dce3a4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Volume 8da50921-b9cc-4bbd-b7cd-0552924c5efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc', 'volume_size': 1} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:18 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d 1073741824" returned: 0 in 0.451s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:18 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d Nov 02 14:42:18 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:18 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d" returned: 0 in 0.284s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-740652241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da50921-b9cc-4bbd-b7cd-0552924c5efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb42cce1013419e9f8a2f5e35d75677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:18Z,use_quota=True,user_id='dda1f684ed71415db6f5639ecee652ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Creating volume 8da50921-b9cc-4bbd-b7cd-0552924c5efc {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:18 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:18 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc 1073741824 Nov 02 14:42:18 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4939f19-0518-4399-882c-3d4a2372a57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced75285-2133-4090-8e8e-e2b612e2993d', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f516c0-5d7d-4c04-b3f1-f6520c111136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:18 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Volume volume-ced75285-2133-4090-8e8e-e2b612e2993d (ced75285-2133-4090-8e8e-e2b612e2993d): created successfully Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f516c0-5d7d-4c04-b3f1-f6520c111136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:18 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (b9749af0-dd0f-4cb7-8587-bac21e20e3ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:18 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-cc822c21-408a-45f4-9aeb-59709900c255 tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:42:19 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc 1073741824" returned: 0 in 0.492s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:19 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc Nov 02 14:42:19 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:19 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc" returned: 0 in 0.251s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f87ba4-afb4-42ff-8b0d-8b57dce3a4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c18d7d-d5f5-4c80-a66c-41a4a7e4b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:19 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Volume volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc (8da50921-b9cc-4bbd-b7cd-0552924c5efc): created successfully Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c18d7d-d5f5-4c80-a66c-41a4a7e4b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:19 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Flow 'volume_create_manager' (8e17f7ca-e2b6-4f2e-a717-c3a4b0edafe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:19 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e4df6dfe-1b36-411e-82fe-46a1ec200889 tempest-ProjectReaderTests-675108922 None] Created volume successfully. Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot 53d66c54-a055-433d-8a07-687231a8ab1c of volume ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[586950ea-4f00-499d-9b6e-671462702f62]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:20 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d Nov 02 14:42:20 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Acquiring lock "cinder-8da50921-b9cc-4bbd-b7cd-0552924c5efc-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Lock "cinder-8da50921-b9cc-4bbd-b7cd-0552924c5efc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Acquiring lock "cinder-quobyte-8da50921-b9cc-4bbd-b7cd-0552924c5efc" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Lock "cinder-quobyte-8da50921-b9cc-4bbd-b7cd-0552924c5efc" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc62b6d7-d465-4c36-ae3f-fc15dec3d1d2]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:20 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d" returned: 0 in 0.454s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:20 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c 1G Nov 02 14:42:20 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc Nov 02 14:42:20 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:20 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:20 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc" returned: 0 in 0.410s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:20 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:20 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc Nov 02 14:42:20 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:21 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c 1G" returned: 0 in 0.514s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced75285-2133-4090-8e8e-e2b612e2993d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:21 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced75285-2133-4090-8e8e-e2b612e2993d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c Nov 02 14:42:21 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:21 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-8da50921-b9cc-4bbd-b7cd-0552924c5efc" returned: 0 in 0.325s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Lock "cinder-quobyte-8da50921-b9cc-4bbd-b7cd-0552924c5efc" released by "delete_volume" :: held 0.797s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Created reservations ['26ac6860-d34e-4769-9fc5-9065a61f7b42', '29495f07-3cc0-44cf-9071-c78b844c2fef', 'e6220325-da77-48b6-874a-83020695d6fa', '69e5b814-40be-4e6b-af5c-8c3f578521a5'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:21 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:21 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:21 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced75285-2133-4090-8e8e-e2b612e2993d -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c" returned: 0 in 0.388s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:21 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c is being set with open permissions: ugo+rw Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:21 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c Nov 02 14:42:21 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:21 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.345s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:21 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Deleted volume successfully. Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-a5c96834-cf28-4faa-9967-8bc64d7b0457 tempest-ProjectReaderTests-675108922 None] Lock "cinder-8da50921-b9cc-4bbd-b7cd-0552924c5efc-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:21 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:21 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:21 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.info Nov 02 14:42:21 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:22 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.info" returned: 0 in 0.292s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:22 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.info is being set with open permissions: ugo+rw Nov 02 14:42:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:22 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.info Nov 02 14:42:22 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:22 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.info" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:22 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:22 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-e5d9ea72-4356-4663-bf83-30b12a66f2ff tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-53d66c54-a055-433d-8a07-687231a8ab1c-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-53d66c54-a055-433d-8a07-687231a8ab1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-ced75285-2133-4090-8e8e-e2b612e2993d" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-ced75285-2133-4090-8e8e-e2b612e2993d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-53d66c54-a055-433d-8a07-687231a8ab1c" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-53d66c54-a055-433d-8a07-687231a8ab1c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot 53d66c54-a055-433d-8a07-687231a8ab1c of volume ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[602b3a8b-590d-45f9-a4a9-f21b847e137c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:23 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c Nov 02 14:42:23 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:23 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c" returned: 0 in 0.428s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced75285-2133-4090-8e8e-e2b612e2993d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ed50b-105e-497e-beba-ae2bb65fb9dd]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:23 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:23 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d Nov 02 14:42:23 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:24 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d" returned: 0 in 0.363s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:24 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c Nov 02 14:42:24 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:24 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c" returned: 0 in 0.415s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:24 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c Nov 02 14:42:24 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:24 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:24 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d.53d66c54-a055-433d-8a07-687231a8ab1c" returned: 0 in 0.279s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-53d66c54-a055-433d-8a07-687231a8ab1c" released by "_delete_snapshot" :: held 1.622s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:24 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-ced75285-2133-4090-8e8e-e2b612e2993d" released by "delete_snapshot" :: held 1.656s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Created reservations ['de6dfef3-3d14-4cae-9d74-209a3b70257a', '9299bc36-793b-4c1d-94f8-60dc1303a11a', 'aeef86a0-f361-455f-b98c-464023d83342', '04754aa6-1928-45bb-8adc-d1da5fa27cda'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:25 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-96624acb-41be-47f5-a5b3-1311ee1b7a32 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-53d66c54-a055-433d-8a07-687231a8ab1c-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-ced75285-2133-4090-8e8e-e2b612e2993d-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-ced75285-2133-4090-8e8e-e2b612e2993d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-ced75285-2133-4090-8e8e-e2b612e2993d" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (c54b65f8-dc1e-4a5b-a002-c08068d97280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca83783-918e-4a19-8e9e-2a437112dec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-ced75285-2133-4090-8e8e-e2b612e2993d" acquired by "delete_volume" :: waited 0.065s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca83783-918e-4a19-8e9e-2a437112dec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541181455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a2ffea-bf86-4ced-8f5f-2089d941218c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:25Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0f36f5-8945-45c2-9b54-fb12a3e7a975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0f36f5-8945-45c2-9b54-fb12a3e7a975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2943188-ebd9-4d77-a82c-d0340857f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2943188-ebd9-4d77-a82c-d0340857f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a2ffea-bf86-4ced-8f5f-2089d941218c', 'volume_name': 'volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d037a056-78e1-465c-ba34-cbe42dfe972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d037a056-78e1-465c-ba34-cbe42dfe972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfd88a2-b074-4679-b030-fdf5567336bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:25 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Volume a1a2ffea-bf86-4ced-8f5f-2089d941218c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c', 'volume_size': 1} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541181455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a2ffea-bf86-4ced-8f5f-2089d941218c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:25Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Creating volume a1a2ffea-bf86-4ced-8f5f-2089d941218c {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:25 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffb3833-b7ab-4b94-8422-e684e2072380]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:25 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:25 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c 1073741824 Nov 02 14:42:25 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:25 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d Nov 02 14:42:25 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:26 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d" returned: 0 in 0.405s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:26 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d Nov 02 14:42:26 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:26 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c 1073741824" returned: 0 in 0.496s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:26 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c Nov 02 14:42:26 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:26 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-ced75285-2133-4090-8e8e-e2b612e2993d" returned: 0 in 0.293s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-ced75285-2133-4090-8e8e-e2b612e2993d" released by "delete_volume" :: held 0.860s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Created reservations ['53dd8003-36b5-4900-937d-457a2d177d9f', 'd5fa8128-4fb2-40ed-8492-1a2dcaee1512', 'd1c2bf80-a1ab-4e46-8693-b11c5f71bcdc', 'f0db5265-5cca-47d0-be4c-ca82d628babf'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:26 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c" returned: 0 in 0.311s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfd88a2-b074-4679-b030-fdf5567336bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864a3985-4150-4b66-bd31-dd5882d771b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:26 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Volume volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c (a1a2ffea-bf86-4ced-8f5f-2089d941218c): created successfully Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864a3985-4150-4b66-bd31-dd5882d771b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (c54b65f8-dc1e-4a5b-a002-c08068d97280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d6f734f5-3d31-4853-9df0-e779c185aff4 tempest-ProjectReaderTests-166911877 None] Created volume successfully. Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:26 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:26 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:26 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.282s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:26 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:26 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2f7003c0-7001-423b-b578-4cdbfb591134 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-ced75285-2133-4090-8e8e-e2b612e2993d-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (0b181e27-a1ee-451a-b5a4-28c052f01966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8d9959-c320-43bc-b40e-c64378f4d81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8d9959-c320-43bc-b40e-c64378f4d81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-6450723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:27Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4a5f07-d679-49c8-a04d-d81fa841a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4a5f07-d679-49c8-a04d-d81fa841a89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039cba50-02a4-476e-89dc-4bf626485102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039cba50-02a4-476e-89dc-4bf626485102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5', 'volume_name': 'volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457a6c83-3519-47c9-91bf-59024ecc49a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457a6c83-3519-47c9-91bf-59024ecc49a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c368f99e-8504-471d-a05d-628d4c1c7b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:27 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Volume f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5', 'volume_size': 1} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-6450723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:27Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Creating volume f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:27 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:27 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 1073741824 Nov 02 14:42:27 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:27 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 1073741824" returned: 0 in 0.508s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:27 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 Nov 02 14:42:27 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-a1a2ffea-bf86-4ced-8f5f-2089d941218c-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Lock "cinder-a1a2ffea-bf86-4ced-8f5f-2089d941218c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-quobyte-a1a2ffea-bf86-4ced-8f5f-2089d941218c" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:27 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-a1a2ffea-bf86-4ced-8f5f-2089d941218c" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea40fa75-c4e0-40d1-87b3-edd073e49750]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:28 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" returned: 0 in 0.269s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c368f99e-8504-471d-a05d-628d4c1c7b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cfa00b-d782-4447-95d5-ff58081757ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:28 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Volume volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 (f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5): created successfully Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11cfa00b-d782-4447-95d5-ff58081757ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (0b181e27-a1ee-451a-b5a4-28c052f01966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:28 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8793a5d0-d5e1-45a4-b849-0334190091a4 tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:42:28 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c Nov 02 14:42:28 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:28 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c" returned: 0 in 0.368s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:28 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c Nov 02 14:42:28 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:28 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-a1a2ffea-bf86-4ced-8f5f-2089d941218c" returned: 0 in 0.249s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-a1a2ffea-bf86-4ced-8f5f-2089d941218c" released by "delete_volume" :: held 0.655s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Created reservations ['b6b20717-a39c-43ad-ac61-3a1a04d99d51', 'c98dd015-ea3a-4b4c-8b0c-d8f7eae1854d', 'a7d50bdf-c160-492a-9198-fa6422713cce', '7749fae8-e741-41b8-b344-914484d6b5fb'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:28 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:28 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:28 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:28 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.243s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:29 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Deleted volume successfully. Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0641af6b-738b-4d9b-8849-92df9d1a888a tempest-ProjectReaderTests-166911877 None] Lock "cinder-a1a2ffea-bf86-4ced-8f5f-2089d941218c-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot f19a61b0-ec61-496c-b55f-4728a9e2eafa of volume f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab187a36-918d-4271-9974-9951fed6b459]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:29 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 Nov 02 14:42:29 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (8aacb091-7eb5-4ef9-b397-694618121ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd73efc-05f2-444f-afbf-c45a31cff370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd73efc-05f2-444f-afbf-c45a31cff370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515202708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:30Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9bf3e5-37a1-4cf4-8de6-82735aa6659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9bf3e5-37a1-4cf4-8de6-82735aa6659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632ab72a-fbec-4300-b575-f427ea530b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632ab72a-fbec-4300-b575-f427ea530b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a', 'volume_name': 'volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dcace6-7d92-4c0d-b494-65d84b865b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dcace6-7d92-4c0d-b494-65d84b865b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f9596d-d895-4658-8412-cec3298dfd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:29 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Volume f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a', 'volume_size': 1} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:29 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:29 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:29 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa 1G Nov 02 14:42:29 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:30 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa 1G" returned: 0 in 0.379s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:30 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa Nov 02 14:42:30 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:30 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa" returned: 0 in 0.286s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:30 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa is being set with open permissions: ugo+rw Nov 02 14:42:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:30 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa Nov 02 14:42:30 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:30 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa" returned: 0 in 0.243s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:30 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:30 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.info Nov 02 14:42:30 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:31 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.info" returned: 0 in 0.256s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:31 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.info is being set with open permissions: ugo+rw Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:31 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.info Nov 02 14:42:31 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:31 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.info" returned: 0 in 0.238s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515202708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:30Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Creating volume f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:31 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:UPDATE=228,cinder:SELECT=190,cinder:INSERT=58,cinder:DELETE=17 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:42:31 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a 1073741824 Nov 02 14:42:31 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=175,cinder:INSERT=66,cinder:UPDATE=237,cinder:DELETE=21 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:42:31 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0810e674-c926-4d96-8bec-441fc6dfe5aa tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-f19a61b0-ec61-496c-b55f-4728a9e2eafa-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Lock "cinder-f19a61b0-ec61-496c-b55f-4728a9e2eafa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-f19a61b0-ec61-496c-b55f-4728a9e2eafa" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-f19a61b0-ec61-496c-b55f-4728a9e2eafa" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot f19a61b0-ec61-496c-b55f-4728a9e2eafa of volume f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7075d5e-d2b8-4f7a-b6e4-9ccca0bb0253]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:31 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa Nov 02 14:42:31 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:31 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a 1073741824" returned: 0 in 0.488s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:31 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:31 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a Nov 02 14:42:31 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:32 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa" returned: 0 in 0.373s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcbf977-be5c-49e6-8627-89177579ae93]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:32 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a" returned: 0 in 0.266s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f9596d-d895-4658-8412-cec3298dfd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:32 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc4a0e-07a0-483f-8281-9fdf882d3afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:32 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:32 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Volume volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a (f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a): created successfully Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cc4a0e-07a0-483f-8281-9fdf882d3afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (8aacb091-7eb5-4ef9-b397-694618121ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:32 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-bf4b2c30-54e3-44c0-a593-43ce206c377f tempest-ProjectReaderTests-166911877 None] Created volume successfully. Nov 02 14:42:32 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" returned: 0 in 0.359s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:32 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa Nov 02 14:42:32 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:32 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa" returned: 0 in 0.334s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:32 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa Nov 02 14:42:32 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Lock "cinder-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:32 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-quobyte-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:33 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5.f19a61b0-ec61-496c-b55f-4728a9e2eafa" returned: 0 in 0.276s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a" acquired by "delete_volume" :: waited 0.040s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-f19a61b0-ec61-496c-b55f-4728a9e2eafa" released by "_delete_snapshot" :: held 1.443s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" released by "delete_snapshot" :: held 1.469s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[201a9ba3-1fd0-4c4e-8d75-5a7216a85d0e]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Created reservations ['c1659fd3-88e8-4e3b-b9b7-7365038ad3bb', 'c88012da-9c9f-46c0-b5d7-3d7b302af166', '03ded172-d69d-4a1b-aa7f-8b04b158927b', '3c7bcfd1-9448-451e-b679-998dfdba262d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:33 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a Nov 02 14:42:33 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:33 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-b44052bc-f265-4807-8d87-0adbb1d4e5ac tempest-ProjectMemberTests-1133871797 None] Lock "cinder-f19a61b0-ec61-496c-b55f-4728a9e2eafa-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:33 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a" returned: 0 in 0.358s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:33 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a Nov 02 14:42:33 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:33 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a" returned: 0 in 0.271s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a" released by "delete_volume" :: held 0.675s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Lock "cinder-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Created reservations ['2692f5da-ab21-4ea7-a0a9-f3ec25d10c5f', '74e64e22-1e7b-499d-8974-df64250485b0', 'a065cd8d-8508-465f-b1fd-0d329abbe024', '1b13095e-64d0-4c09-a37e-23799b52afee'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0db4a0-bfc9-42f0-abc1-b9faf276e73d]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:33 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:33 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:33 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:33 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 Nov 02 14:42:33 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:34 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:34 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Deleted volume successfully. Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-8ebb17cc-08a5-4aec-937e-9a85560db0af tempest-ProjectReaderTests-166911877 None] Lock "cinder-f89b4b24-2497-4cad-bb6d-4cbeae2d6d9a-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:34 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" returned: 0 in 0.401s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:34 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5 Nov 02 14:42:34 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:34 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" returned: 0 in 0.255s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5" released by "delete_volume" :: held 0.735s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (8853b520-bcf6-4e92-a20b-09faf9f8fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1123b0-5589-4457-bedd-6056449e3cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1123b0-5589-4457-bedd-6056449e3cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018893847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334b37e0-015b-49b9-a18e-fcd8a7ae6e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:35Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5402a07e-ef20-4c92-aeaf-8c0f89397012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5402a07e-ef20-4c92-aeaf-8c0f89397012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f2c266-4ba9-4824-8093-f2f054db1179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f2c266-4ba9-4824-8093-f2f054db1179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334b37e0-015b-49b9-a18e-fcd8a7ae6e03', 'volume_name': 'volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37635981-c543-4a30-9b9a-2721f6f401e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37635981-c543-4a30-9b9a-2721f6f401e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00087b6-99d2-4f72-ac3f-1c904c0108b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:34 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Volume 334b37e0-015b-49b9-a18e-fcd8a7ae6e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03', 'volume_size': 1} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2018893847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334b37e0-015b-49b9-a18e-fcd8a7ae6e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:35Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Creating volume 334b37e0-015b-49b9-a18e-fcd8a7ae6e03 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:34 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:34 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 1073741824 Nov 02 14:42:34 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Created reservations ['6edae541-703e-4bf5-8bf9-a504a996a0cb', '6747551b-5eeb-41b2-85bd-259a6fd358bd', '94402ac0-3ffe-4aba-983c-81c1c8019f95', 'fe4f767f-7e57-4345-b3c6-d0f7e49edaa6'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:34 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:34 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:34 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:35 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.267s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-9347aacc-c156-4d88-aa64-036ff19e33ce tempest-ProjectMemberTests-1133871797 None] Lock "cinder-f1fe88d2-c70f-4d9b-ba56-ec92cfb911e5-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:35 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 1073741824" returned: 0 in 0.474s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:35 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 Nov 02 14:42:35 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (1e14fd62-a1e3-4328-9659-dc6dd57a7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef76544-e14d-4fb8-a18c-d1f1fb4d55ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef76544-e14d-4fb8-a18c-d1f1fb4d55ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97405765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3051e0c-aa1f-407c-912c-6414761d2259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:35Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d73206d-9fc1-4125-a5db-fe80da4352e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:35 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d73206d-9fc1-4125-a5db-fe80da4352e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5200f9cb-df3f-4cf5-aa4a-3b189bfebc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5200f9cb-df3f-4cf5-aa4a-3b189bfebc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3051e0c-aa1f-407c-912c-6414761d2259', 'volume_name': 'volume-b3051e0c-aa1f-407c-912c-6414761d2259', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc88e9d4-4121-4c7c-96d5-b7995065380e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc88e9d4-4121-4c7c-96d5-b7995065380e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0bc774-cfc9-455e-bfdb-641522f72af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Volume b3051e0c-aa1f-407c-912c-6414761d2259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3051e0c-aa1f-407c-912c-6414761d2259', 'volume_size': 1} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03" returned: 0 in 0.270s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97405765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3051e0c-aa1f-407c-912c-6414761d2259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:35Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Creating volume b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:35 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00087b6-99d2-4f72-ac3f-1c904c0108b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090fd52-b12b-411e-b5d6-0af016a2df43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:35 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 1073741824 Nov 02 14:42:35 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:35 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Volume volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 (334b37e0-015b-49b9-a18e-fcd8a7ae6e03): created successfully Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1090fd52-b12b-411e-b5d6-0af016a2df43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (8853b520-bcf6-4e92-a20b-09faf9f8fb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:35 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-63c29730-2f6e-4742-a171-2a9af4b83fdc tempest-ProjectReaderTests-166911877 None] Created volume successfully. Nov 02 14:42:35 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 1073741824" returned: 0 in 0.424s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:35 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:35 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 Nov 02 14:42:35 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:36 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0bc774-cfc9-455e-bfdb-641522f72af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3051e0c-aa1f-407c-912c-6414761d2259', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1437d1c3-e81c-4814-b912-76416b20a574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:36 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Volume volume-b3051e0c-aa1f-407c-912c-6414761d2259 (b3051e0c-aa1f-407c-912c-6414761d2259): created successfully Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1437d1c3-e81c-4814-b912-76416b20a574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (1e14fd62-a1e3-4328-9659-dc6dd57a7d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:36 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d4ef0319-c3f7-43cc-ba43-8be2ff2077b6 tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot 630e0285-9f57-4575-b9af-8f193d980947 of volume b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa86aaf-aaac-4903-821f-aea5fbd2c725]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:36 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 Nov 02 14:42:36 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-334b37e0-015b-49b9-a18e-fcd8a7ae6e03-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Lock "cinder-334b37e0-015b-49b9-a18e-fcd8a7ae6e03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-quobyte-334b37e0-015b-49b9-a18e-fcd8a7ae6e03" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-334b37e0-015b-49b9-a18e-fcd8a7ae6e03" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81e2691-7778-4ec4-b32c-0467a34ce988]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:36 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 Nov 02 14:42:36 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:36 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259" returned: 0 in 0.393s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:36 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:36 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 1G Nov 02 14:42:36 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:37 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03" returned: 0 in 0.374s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:37 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03 Nov 02 14:42:37 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:37 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 1G" returned: 0 in 0.426s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3051e0c-aa1f-407c-912c-6414761d2259 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:37 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3051e0c-aa1f-407c-912c-6414761d2259 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 Nov 02 14:42:37 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:37 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-334b37e0-015b-49b9-a18e-fcd8a7ae6e03" returned: 0 in 0.274s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-334b37e0-015b-49b9-a18e-fcd8a7ae6e03" released by "delete_volume" :: held 0.695s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Created reservations ['3d3e2a9a-cc83-4f6e-b6b0-1742182f70eb', '11623d63-73cd-44f5-9099-9b74f0ec565f', '594c33b3-4ec1-4019-85bf-ff2f3fa73e10', '6dfe5c51-218a-42f2-91d1-2c25dcb3fc3b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:37 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:37 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:37 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3051e0c-aa1f-407c-912c-6414761d2259 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947" returned: 0 in 0.314s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:37 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 is being set with open permissions: ugo+rw Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:37 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 Nov 02 14:42:37 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:37 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.267s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:37 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Deleted volume successfully. Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c62d96af-8e46-4e5d-a8ee-13f6de09a00d tempest-ProjectReaderTests-166911877 None] Lock "cinder-334b37e0-015b-49b9-a18e-fcd8a7ae6e03-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:37 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:37 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:38 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.info Nov 02 14:42:38 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:38 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.info" returned: 0 in 0.261s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:38 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.info is being set with open permissions: ugo+rw Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:38 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.info Nov 02 14:42:38 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (9c0d4060-ace7-4312-8b65-c7c81245a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019ca092-b3ce-4f85-b82b-092db5d8f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019ca092-b3ce-4f85-b82b-092db5d8f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404323800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9674a1-dc8b-4472-984e-5f8f4f5b2e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:38Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6aca6c1-5a10-4e41-866d-7cef01adda5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6aca6c1-5a10-4e41-866d-7cef01adda5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a55e8-a6c9-436f-9c25-37b7daff1f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240a55e8-a6c9-436f-9c25-37b7daff1f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9674a1-dc8b-4472-984e-5f8f4f5b2e0e', 'volume_name': 'volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435868b3-5e50-4906-9b11-1df280f42f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435868b3-5e50-4906-9b11-1df280f42f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e630bba-86d5-4cb3-b76d-16a56f3c29ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:38 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Volume db9674a1-dc8b-4472-984e-5f8f4f5b2e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e', 'volume_size': 1} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:38 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.info" returned: 0 in 0.250s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404323800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9674a1-dc8b-4472-984e-5f8f4f5b2e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30eb8fd60534051ab7f26ae0d2cb8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:38Z,use_quota=True,user_id='e1827164ce72472f90eb82771e26f422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Creating volume db9674a1-dc8b-4472-984e-5f8f4f5b2e0e {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:38 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:38 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e 1073741824 Nov 02 14:42:38 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:38 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-34d32ab6-18d0-479c-bc73-da192e754ff3 tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-630e0285-9f57-4575-b9af-8f193d980947-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Lock "cinder-630e0285-9f57-4575-b9af-8f193d980947-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-b3051e0c-aa1f-407c-912c-6414761d2259" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-b3051e0c-aa1f-407c-912c-6414761d2259" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-630e0285-9f57-4575-b9af-8f193d980947" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-630e0285-9f57-4575-b9af-8f193d980947" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot 630e0285-9f57-4575-b9af-8f193d980947 of volume b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6b596c-09ad-4d34-8822-85b35197b896]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:38 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 Nov 02 14:42:38 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:38 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e 1073741824" returned: 0 in 0.431s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:38 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:39 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e Nov 02 14:42:39 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:39 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947" returned: 0 in 0.383s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3051e0c-aa1f-407c-912c-6414761d2259(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:39 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:39 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a70b5-817c-4a52-8d94-25999585836c]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:39 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e" returned: 0 in 0.280s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e630bba-86d5-4cb3-b76d-16a56f3c29ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cdb3d3-be5c-44aa-b7c7-b81635f9ca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:39 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Volume volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e (db9674a1-dc8b-4472-984e-5f8f4f5b2e0e): created successfully Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cdb3d3-be5c-44aa-b7c7-b81635f9ca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:39 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 Nov 02 14:42:39 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Flow 'volume_create_manager' (9c0d4060-ace7-4312-8b65-c7c81245a421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:39 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-b2242583-4c99-4266-ad50-8081df866e3b tempest-ProjectReaderTests-166911877 None] Created volume successfully. Nov 02 14:42:39 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.260s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 14:42:39 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259" returned: 0 in 0.379s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:39 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 Nov 02 14:42:39 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:39 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947" returned: 0 in 0.340s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:39 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947 Nov 02 14:42:39 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:40 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259.630e0285-9f57-4575-b9af-8f193d980947" returned: 0 in 0.239s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-630e0285-9f57-4575-b9af-8f193d980947" released by "_delete_snapshot" :: held 1.452s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-b3051e0c-aa1f-407c-912c-6414761d2259" released by "delete_snapshot" :: held 1.475s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Created reservations ['0eae6a01-d60d-4b7a-8b45-93457eb9b5ea', '55effd8e-b4b6-4b32-9f48-0ecc951dba78', 'd41fb82f-8bd9-436a-b8f0-84efa68620b6', '7b12dea5-f01e-4cc1-b570-d33910a01756'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:40 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-31269142-37e7-4a40-b72b-01bae1707eca tempest-ProjectMemberTests-1133871797 None] Lock "cinder-630e0285-9f57-4575-b9af-8f193d980947-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Lock "cinder-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Acquiring lock "cinder-quobyte-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e" acquired by "delete_volume" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dea4c5-6329-420b-9dbb-9894f1a895cf]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:40 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e Nov 02 14:42:40 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-b3051e0c-aa1f-407c-912c-6414761d2259-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Lock "cinder-b3051e0c-aa1f-407c-912c-6414761d2259-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:40 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e" returned: 0 in 0.392s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-b3051e0c-aa1f-407c-912c-6414761d2259" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:40 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e Nov 02 14:42:40 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-b3051e0c-aa1f-407c-912c-6414761d2259" acquired by "delete_volume" :: waited 0.024s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530a6b2-5f58-428c-89f0-2f66a4835396]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:40 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:41 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 Nov 02 14:42:41 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:41 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e" returned: 0 in 0.254s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Lock "cinder-quobyte-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e" released by "delete_volume" :: held 0.689s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Created reservations ['119f8fd8-4a0a-4148-a078-d14d8c39ae95', '52f48898-49b3-48df-a6d8-7e616cd7bb6b', 'afc6977f-bcc4-482e-bb00-14e0a367c30f', '54a8b6aa-823c-41c3-9825-0047373d45cd'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:41 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:41 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:41 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259" returned: 0 in 0.369s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:41 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259 Nov 02 14:42:41 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:41 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:41 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Deleted volume successfully. Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-c6e56025-a83e-4810-aeb7-b96286e4afb6 tempest-ProjectReaderTests-166911877 None] Lock "cinder-db9674a1-dc8b-4472-984e-5f8f4f5b2e0e-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:41 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-b3051e0c-aa1f-407c-912c-6414761d2259" returned: 0 in 0.265s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-b3051e0c-aa1f-407c-912c-6414761d2259" released by "delete_volume" :: held 0.705s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Created reservations ['f0b868c9-ff7b-4027-8485-2a22a1e4f896', 'b14148fe-6177-48fc-9680-704f39f2ca21', '72cd4133-1c14-4712-9f3e-025889469eee', 'cccb1dce-d70d-4d17-a022-10bae48eba8b'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:41 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:41 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:41 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:42 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.253s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:42 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-0fd1be2b-707b-4bf0-9986-a87b2ff48efe tempest-ProjectMemberTests-1133871797 None] Lock "cinder-b3051e0c-aa1f-407c-912c-6414761d2259-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (e8fc65de-9d00-437a-aa94-4e87f609638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907d631a-c399-4804-8855-4f8c3660c8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907d631a-c399-4804-8855-4f8c3660c8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683466506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab77cbb-cf54-434d-8bb1-181a61c10db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:42Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a1a453-7f9e-49d3-9b29-f389156b5584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a1a453-7f9e-49d3-9b29-f389156b5584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e701c7-c177-4eb2-b5c6-efd16810fa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e701c7-c177-4eb2-b5c6-efd16810fa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab77cbb-cf54-434d-8bb1-181a61c10db5', 'volume_name': 'volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ff5c32-1d8a-476a-941a-f6df21c28173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ff5c32-1d8a-476a-941a-f6df21c28173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc8e299-274b-4ea5-a3eb-82d9fffca8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:42 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Volume 5ab77cbb-cf54-434d-8bb1-181a61c10db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5', 'volume_size': 1} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683466506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab77cbb-cf54-434d-8bb1-181a61c10db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:42Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Creating volume 5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:42 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:42 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:42 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 1073741824 Nov 02 14:42:42 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:43 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 1073741824" returned: 0 in 0.469s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:43 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 Nov 02 14:42:43 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:43 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5" returned: 0 in 0.242s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc8e299-274b-4ea5-a3eb-82d9fffca8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de0bdc7-6fb3-49f3-96b5-aef32d367715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:43 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Volume volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 (5ab77cbb-cf54-434d-8bb1-181a61c10db5): created successfully Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de0bdc7-6fb3-49f3-96b5-aef32d367715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:43 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (e8fc65de-9d00-437a-aa94-4e87f609638a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:43 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-573d3008-080e-4716-a2d9-eaa46a5d8bfe tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:42:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:44 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot 67bd4a2d-8593-420c-9a0d-999d35b766ae of volume 5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:44 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e713b8-a23f-457c-9595-f52da8c9287a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:44 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:44 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 Nov 02 14:42:44 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:45 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5" returned: 0 in 0.364s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:45 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae 1G Nov 02 14:42:45 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:45 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae 1G" returned: 0 in 0.382s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:45 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae Nov 02 14:42:45 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:45 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:45 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae is being set with open permissions: ugo+rw Nov 02 14:42:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:45 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae Nov 02 14:42:45 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:45 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:45 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae" returned: 0 in 0.239s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:46 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.info Nov 02 14:42:46 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:46 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.info" returned: 0 in 0.240s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:46 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.info is being set with open permissions: ugo+rw Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:46 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.info Nov 02 14:42:46 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:46 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.info" returned: 0 in 0.236s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:46 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-80c44119-467f-49a0-80af-f10fb93b8165 tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-67bd4a2d-8593-420c-9a0d-999d35b766ae-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-67bd4a2d-8593-420c-9a0d-999d35b766ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-5ab77cbb-cf54-434d-8bb1-181a61c10db5" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-5ab77cbb-cf54-434d-8bb1-181a61c10db5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-67bd4a2d-8593-420c-9a0d-999d35b766ae" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-67bd4a2d-8593-420c-9a0d-999d35b766ae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot 67bd4a2d-8593-420c-9a0d-999d35b766ae of volume 5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b618f-e93d-4207-8c4b-b0c21103926f]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:46 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:46 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae Nov 02 14:42:46 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:47 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae" returned: 0 in 0.366s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbd479c-9273-4497-9ca8-e00ccefd740a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:47 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 Nov 02 14:42:47 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:47 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5" returned: 0 in 0.349s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:47 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae Nov 02 14:42:47 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:47 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae" returned: 0 in 0.327s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:47 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:47 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae Nov 02 14:42:47 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:48 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:48 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5.67bd4a2d-8593-420c-9a0d-999d35b766ae" returned: 0 in 0.248s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-67bd4a2d-8593-420c-9a0d-999d35b766ae" released by "_delete_snapshot" :: held 1.380s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-5ab77cbb-cf54-434d-8bb1-181a61c10db5" released by "delete_snapshot" :: held 1.403s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:48 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Created reservations ['ce1ec215-3854-4244-871d-aacacd4157ca', 'ccbe2dff-a399-4f99-8c31-b480cb5b881a', 'e95e9634-b0bb-4a55-a1b4-40c02dbdebd6', '2edf6e7a-3b9e-44b4-87af-b748f2840eeb'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:48 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:42:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-d6985d02-77f4-4587-b971-9c0ed55ae9b1 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-67bd4a2d-8593-420c-9a0d-999d35b766ae-delete_snapshot" released by "delete_snapshot" :: held 1.531s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-5ab77cbb-cf54-434d-8bb1-181a61c10db5-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:48 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-5ab77cbb-cf54-434d-8bb1-181a61c10db5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-5ab77cbb-cf54-434d-8bb1-181a61c10db5" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-5ab77cbb-cf54-434d-8bb1-181a61c10db5" acquired by "delete_volume" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[2456827e-ec99-49eb-9839-17e5c6228876]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:49 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 Nov 02 14:42:49 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:49 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5" returned: 0 in 0.359s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:49 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5 Nov 02 14:42:49 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:49 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-5ab77cbb-cf54-434d-8bb1-181a61c10db5" returned: 0 in 0.249s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-5ab77cbb-cf54-434d-8bb1-181a61c10db5" released by "delete_volume" :: held 0.668s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Created reservations ['5df60e02-8532-4374-831c-abef0e4144aa', '459e841e-f191-41e9-962a-3c4a78d65b66', 'de1b0a0e-2ae6-493c-88a5-1e354f23823b', 'eab95869-a33b-4b66-9609-d4f4b76eb7b0'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:49 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:49 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:49 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:50 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.241s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:50 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-79a7581c-2c1c-4531-8b48-6cfd72419ef6 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-5ab77cbb-cf54-434d-8bb1-181a61c10db5-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (fee3a06e-d287-427b-ae1b-c8106fd5ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bc83ff-8e9f-46c1-8a2a-51f04682fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bc83ff-8e9f-46c1-8a2a-51f04682fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307088868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4262584-8f02-4896-a743-e57f12b58469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:50Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cb124b-a31a-4030-9fb4-df3e79e8c00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cb124b-a31a-4030-9fb4-df3e79e8c00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccab6026-0ad7-4aee-8b7c-7f439eff2d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccab6026-0ad7-4aee-8b7c-7f439eff2d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4262584-8f02-4896-a743-e57f12b58469', 'volume_name': 'volume-d4262584-8f02-4896-a743-e57f12b58469', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4007d04a-d286-4129-bbca-a78db79e7e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4007d04a-d286-4129-bbca-a78db79e7e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9226de-6d95-4946-aaef-ebc590d8e4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:50 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Volume d4262584-8f02-4896-a743-e57f12b58469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4262584-8f02-4896-a743-e57f12b58469', 'volume_size': 1} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307088868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4262584-8f02-4896-a743-e57f12b58469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:50Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Creating volume d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:50 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:50 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:50 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 1073741824 Nov 02 14:42:50 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:51 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 1073741824" returned: 0 in 0.416s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:51 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 Nov 02 14:42:51 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:51 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469" returned: 0 in 0.238s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9226de-6d95-4946-aaef-ebc590d8e4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4262584-8f02-4896-a743-e57f12b58469', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87200104-8969-40ad-86a1-79e03da94483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:51 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Volume volume-d4262584-8f02-4896-a743-e57f12b58469 (d4262584-8f02-4896-a743-e57f12b58469): created successfully Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87200104-8969-40ad-86a1-79e03da94483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (fee3a06e-d287-427b-ae1b-c8106fd5ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:51 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-29b4f830-3f97-4e0a-aae7-0c02199c3880 tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot 8590db18-24bd-4bf7-81cf-9cb0094e93f1 of volume d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[a209b6ef-24af-44f5-bf67-0629337bf418]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:51 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:51 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 Nov 02 14:42:51 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:52 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469" returned: 0 in 0.365s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:52 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 1G Nov 02 14:42:52 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:52 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 1G" returned: 0 in 0.385s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4262584-8f02-4896-a743-e57f12b58469 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:52 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4262584-8f02-4896-a743-e57f12b58469 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 Nov 02 14:42:52 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:52 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4262584-8f02-4896-a743-e57f12b58469 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1" returned: 0 in 0.288s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:52 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 is being set with open permissions: ugo+rw Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:52 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 Nov 02 14:42:52 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:52 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1" returned: 0 in 0.236s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:52 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:53 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.info Nov 02 14:42:53 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:53 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.info" returned: 0 in 0.247s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:53 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.info is being set with open permissions: ugo+rw Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:53 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.info Nov 02 14:42:53 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:53 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.info" returned: 0 in 0.237s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:53 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-9669f682-4f98-4cb4-a6d5-6182912baa4d tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-8590db18-24bd-4bf7-81cf-9cb0094e93f1-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-8590db18-24bd-4bf7-81cf-9cb0094e93f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-d4262584-8f02-4896-a743-e57f12b58469" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-d4262584-8f02-4896-a743-e57f12b58469" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-8590db18-24bd-4bf7-81cf-9cb0094e93f1" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-8590db18-24bd-4bf7-81cf-9cb0094e93f1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot 8590db18-24bd-4bf7-81cf-9cb0094e93f1 of volume d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ce3491-b2f5-4f0a-80ee-45e167272eab]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:53 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:54 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 Nov 02 14:42:54 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:54 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1" returned: 0 in 0.359s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4262584-8f02-4896-a743-e57f12b58469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[781d2b58-ad6b-4843-9ff2-81959280bfb7]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:54 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 Nov 02 14:42:54 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:54 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469" returned: 0 in 0.351s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:54 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 Nov 02 14:42:54 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:54 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1" returned: 0 in 0.334s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:54 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:54 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1 Nov 02 14:42:54 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:55 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:55 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469.8590db18-24bd-4bf7-81cf-9cb0094e93f1" returned: 0 in 0.239s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-8590db18-24bd-4bf7-81cf-9cb0094e93f1" released by "_delete_snapshot" :: held 1.373s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-d4262584-8f02-4896-a743-e57f12b58469" released by "delete_snapshot" :: held 1.395s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:55 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Created reservations ['170f76a9-c0af-4836-875f-ef703a159b27', '94edb978-e84c-4e95-a73d-3ee76bd8f6be', 'a24dce35-9902-49c7-bef0-f47b2a0f7440', 'c3e0a97e-52e8-4d5d-b0a3-f7c9487eb44d'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:55 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:42:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-adef942d-2878-4544-9116-0d231e2488c8 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-8590db18-24bd-4bf7-81cf-9cb0094e93f1-delete_snapshot" released by "delete_snapshot" :: held 1.520s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-d4262584-8f02-4896-a743-e57f12b58469-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:55 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-d4262584-8f02-4896-a743-e57f12b58469-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-d4262584-8f02-4896-a743-e57f12b58469" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-d4262584-8f02-4896-a743-e57f12b58469" acquired by "delete_volume" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f061a-37b5-4c26-8603-abe63f900613]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:56 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 Nov 02 14:42:56 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:56 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469" returned: 0 in 0.357s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:56 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469 Nov 02 14:42:56 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:56 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-d4262584-8f02-4896-a743-e57f12b58469" returned: 0 in 0.242s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-d4262584-8f02-4896-a743-e57f12b58469" released by "delete_volume" :: held 0.658s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Created reservations ['67b513df-e80e-4677-a88d-2b98280b3e15', '496c3c17-0c89-47a8-b4bc-bd796f2a0e12', 'e5026fe7-268f-4a1a-8f44-265b5aac822c', '72eab79a-572e-4251-a9b6-ad0c3d999242'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:56 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:56 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:42:56 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:57 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.247s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:42:57 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-2800acce-e5b6-454a-a1a9-2eac1fc986a0 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-d4262584-8f02-4896-a743-e57f12b58469-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.flows.manager.create_volume [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86978) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (a9219f3c-35e3-4344-9b4d-e80d0e1ebaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbacc9b5-3840-4896-8321-b6b700e0ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbacc9b5-3840-4896-8321-b6b700e0ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071866973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8661603-1587-40e8-8e81-c826a9643386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:57Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c65c79f-c7b1-4c14-80c5-a9155fa36bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c65c79f-c7b1-4c14-80c5-a9155fa36bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e3111a-82da-4ec8-930a-c9af08c94d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e3111a-82da-4ec8-930a-c9af08c94d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8661603-1587-40e8-8e81-c826a9643386', 'volume_name': 'volume-c8661603-1587-40e8-8e81-c826a9643386', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d055ffb5-a7d6-43ff-a126-bcdcb1b8ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d055ffb5-a7d6-43ff-a126-bcdcb1b8ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f71da1-da8f-4288-8c51-47d308198b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:57 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Volume c8661603-1587-40e8-8e81-c826a9643386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8661603-1587-40e8-8e81-c826a9643386', 'volume_size': 1} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T13:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071866973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8661603-1587-40e8-8e81-c826a9643386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587965df144545998edac07b6e4ddec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T13:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T13:42:57Z,use_quota=True,user_id='1fe7c1000b3e487d811c6e11b733909e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc7fcdc9-1b75-4668-b660-159aa3f6a32c),volume_type_id=bc7fcdc9-1b75-4668-b660-159aa3f6a32c)}" {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Creating volume c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Selected osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 as target Quobyte volume. {{(pid=86978) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 14:42:57 devstack cinder-volume[86978]: INFO cinder.volume.drivers.remotefs [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] casted to osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86 Nov 02 14:42:57 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 1073741824 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:57 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 1073741824 Nov 02 14:42:57 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:58 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 1073741824" returned: 0 in 0.407s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:58 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 Nov 02 14:42:58 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:58 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386" returned: 0 in 0.243s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'} {{(pid=86978) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f71da1-da8f-4288-8c51-47d308198b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8661603-1587-40e8-8e81-c826a9643386', 'volume_size': 1}' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2d255e-b61e-4cb4-9b3f-5bedc12b6193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 14:42:58 devstack cinder-volume[86978]: INFO cinder.volume.flows.manager.create_volume [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Volume volume-c8661603-1587-40e8-8e81-c826a9643386 (c8661603-1587-40e8-8e81-c826a9643386): created successfully Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2d255e-b61e-4cb4-9b3f-5bedc12b6193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86978) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Flow 'volume_create_manager' (a9219f3c-35e3-4344-9b4d-e80d0e1ebaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86978) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 14:42:58 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-c652c792-8ddb-4a29-a2ea-23bebe9ae459 tempest-ProjectMemberTests-1133871797 None] Created volume successfully. Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Creating offline snapshot 2b392279-1430-4312-a66c-4fd824559020 of volume c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[82042dd8-c60f-4bfd-96fa-cbfb042ee66a]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:42:58 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:58 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 Nov 02 14:42:58 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:59 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386" returned: 0 in 0.351s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 1G {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:59 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 1G Nov 02 14:42:59 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:59 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 1G" returned: 0 in 0.384s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8661603-1587-40e8-8e81-c826a9643386 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:59 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8661603-1587-40e8-8e81-c826a9643386 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 Nov 02 14:42:59 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:42:59 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Nov 02 14:42:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8661603-1587-40e8-8e81-c826a9643386 -F qcow2 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020" returned: 0 in 0.300s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:42:59 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 is being set with open permissions: ugo+rw Nov 02 14:42:59 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:42:59 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 Nov 02 14:42:59 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:00 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020" returned: 0 in 0.244s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:00 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.info Nov 02 14:43:00 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:00 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.info" returned: 0 in 0.246s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:00 devstack cinder-volume[86978]: WARNING cinder.volume.drivers.remotefs [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.info is being set with open permissions: ugo+rw Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.info {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:00 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.info Nov 02 14:43:00 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:00 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.info" returned: 0 in 0.252s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:43:00 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-17b465af-ea50-4a62-819a-0f046775e025 tempest-ProjectMemberTests-1133871797 None] Create snapshot completed successfully Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-2b392279-1430-4312-a66c-4fd824559020-delete_snapshot" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-2b392279-1430-4312-a66c-4fd824559020-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-c8661603-1587-40e8-8e81-c826a9643386" by "delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-c8661603-1587-40e8-8e81-c826a9643386" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-2b392279-1430-4312-a66c-4fd824559020" by "_delete_snapshot" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-2b392279-1430-4312-a66c-4fd824559020" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Deleting offline snapshot 2b392279-1430-4312-a66c-4fd824559020 of volume c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] snapshot_file for this snap is: volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 {{(pid=86978) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[18447126-6594-40d9-a590-7b01b77fb0f1]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:43:00 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:01 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 Nov 02 14:43:01 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:01 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020" returned: 0 in 0.350s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:01 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.remotefs [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8661603-1587-40e8-8e81-c826a9643386(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86978) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 14:43:01 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ac2e8-d696-4858-a1b9-6ce37516c0d4]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:43:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:01 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 Nov 02 14:43:01 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:01 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386" returned: 0 in 0.361s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:01 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:01 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 Nov 02 14:43:01 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:02 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020" returned: 0 in 0.333s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:02 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020 Nov 02 14:43:02 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:02 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:02 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386.2b392279-1430-4312-a66c-4fd824559020" returned: 0 in 0.250s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-2b392279-1430-4312-a66c-4fd824559020" released by "_delete_snapshot" :: held 1.388s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:43:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-c8661603-1587-40e8-8e81-c826a9643386" released by "delete_snapshot" :: held 1.408s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:43:02 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Created reservations ['e6ae81e2-b41e-49e7-a18c-c222856d4c72', '0b3c0195-6277-48a3-a700-69e4d6f5d244', 'd7382eea-acdf-48e9-a0c8-186fcbe0f8e5', '16d143cc-fc80-4bb8-966d-4445c5d48133'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:43:02 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Delete snapshot completed successfully. Nov 02 14:43:02 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-149da002-3e83-4db7-85ff-06cb8eb5b1c7 tempest-ProjectMemberTests-1133871797 None] Lock "cinder-2b392279-1430-4312-a66c-4fd824559020-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-c8661603-1587-40e8-8e81-c826a9643386-delete_volume" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Lock "cinder-c8661603-1587-40e8-8e81-c826a9643386-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Acquiring lock "cinder-quobyte-c8661603-1587-40e8-8e81-c826a9643386" by "delete_volume" {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-c8661603-1587-40e8-8e81-c826a9643386" acquired by "delete_volume" :: waited 0.014s {{(pid=86978) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo.privsep.daemon [-] privsep: reply[854eb4fb-2236-4e08-a222-b123e3f113c9]: (4, 'qcow2') {{(pid=88590) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:03 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 Nov 02 14:43:03 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:03 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386" returned: 0 in 0.363s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:03 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386 Nov 02 14:43:03 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:03 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418/volume-c8661603-1587-40e8-8e81-c826a9643386" returned: 0 in 0.249s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Lock "cinder-quobyte-c8661603-1587-40e8-8e81-c826a9643386" released by "delete_volume" :: held 0.672s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.quota [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Created reservations ['f1730a1d-aa3f-47d7-b978-5a3df1057d4c', 'e4cba380-3b74-4e63-8c9b-4ef4bbe5dfa0', 'a92a0562-ac4d-4a74-a8d5-b0ff4e140d66', 'ce75692a-cf08-4049-aa97-d1c4ebbaa644'] {{(pid=86978) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:43:03 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:03 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:43:03 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:04 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:04 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.250s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:04 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:43:04 devstack cinder-volume[86978]: INFO cinder.volume.manager [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Deleted volume successfully. Nov 02 14:43:04 devstack cinder-volume[86978]: DEBUG cinder.coordination [None req-6a2dc493-702b-40c0-aa64-88962ff9203c tempest-ProjectMemberTests-1133871797 None] Lock "cinder-c8661603-1587-40e8-8e81-c826a9643386-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86978) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 14:43:13 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:DELETE=10,cinder:SELECT=87,cinder:INSERT=34,cinder:UPDATE=120 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:43:14 devstack cinder-volume[86978]: DEBUG dbcounter [-] [86978] Writing DB stats cinder:SELECT=84,cinder:UPDATE=116,cinder:DELETE=10,cinder:INSERT=29 {{(pid=86978) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86': None} {{(pid=86978) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG cinder.volume.drivers.quobyte [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06d05834-b26d-46b2-b960-a6eb7155dc86'] {{(pid=86978) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.lockutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86978) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 14:43:39 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418 Nov 02 14:43:39 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 14:43:39 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG oslo_concurrency.processutils [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/57a8cec6fa65d5acc7ea785a4dcc4418" returned: 0 in 0.235s {{(pid=86978) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG cinder.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Notifying Schedulers of capabilities ... {{(pid=86978) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG oslo_service.periodic_task [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] Running periodic task VolumeManager._thread_info {{(pid=86978) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread count: 28 {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 14:43:39 devstack cinder-volume[86978]: DEBUG cinder.volume.manager [None req-477442d2-a465-4a08-9875-083bd34c4169 None None] thread info: [<_MainThread(MainThread, started 139757954171008)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86978) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}